2024-04-25T01:50:13.172 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T01:50:13.173 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --verbose --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359 --description fs/upgrade/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}} -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/orig.config.yaml 2024-04-25T01:50:13.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T01:50:13.305 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359 branch: squid description: fs/upgrade/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672359' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false machine_type: smithi name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCE+bBPmXXt7i0A5x++WS6uF/Ie30NLgpkX55ThwlsNo79s16FrB2M3frIWOg9MSU7I59dHziMtKUUabAiAbhzY= smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOKh9xOsjOZz3VucbaA5sI9lAGH706DaDG2fINOy3URJ6KVTm1JhpS60K4ALKCMGSBis1yE2NGuOdXBBLV3d+4= tasks: - install: branch: nautilus exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing nautilus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client nautilus - print: '**** done ceph' - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_newops teuthology: branch: nautilus fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() or syntax_version() == 'v2' then reject() end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T01:50:13.305 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T01:50:13.306 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T01:50:13.306 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T01:50:13.308 INFO:teuthology.task.internal:Checking packages... 2024-04-25T01:50:13.333 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T01:50:13.333 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:50:13.333 INFO:teuthology.packaging:ref: None 2024-04-25T01:50:13.333 INFO:teuthology.packaging:tag: None 2024-04-25T01:50:13.333 INFO:teuthology.packaging:branch: squid 2024-04-25T01:50:13.333 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:50:13.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=squid 2024-04-25T01:50:13.666 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T01:50:13.667 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T01:50:13.674 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T01:50:13.674 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T01:50:13.679 INFO:teuthology.task.internal:Saving configuration 2024-04-25T01:50:13.695 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T01:50:13.701 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T01:50:13.727 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:44:47.392877', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCE+bBPmXXt7i0A5x++WS6uF/Ie30NLgpkX55ThwlsNo79s16FrB2M3frIWOg9MSU7I59dHziMtKUUabAiAbhzY='} 2024-04-25T01:50:13.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:44:47.391681', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOKh9xOsjOZz3VucbaA5sI9lAGH706DaDG2fINOy3URJ6KVTm1JhpS60K4ALKCMGSBis1yE2NGuOdXBBLV3d+4='} 2024-04-25T01:50:13.749 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T01:50:13.756 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-25T01:50:13.756 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['client.0'] 2024-04-25T01:50:13.756 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T01:50:13.831 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdfea21e3a0>, signals=[15]) 2024-04-25T01:50:13.831 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T01:50:13.842 INFO:teuthology.task.internal:Opening connections... 2024-04-25T01:50:13.842 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T01:50:13.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:50:13.920 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-04-25T01:50:13.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:50:13.990 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T01:50:13.997 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-25T01:50:14.020 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-25T01:50:14.020 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-25T01:50:14.082 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-04-25T01:50:14.082 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8" 2024-04-25T01:50:14.082 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-25T01:50:14.083 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:50:14.085 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-25T01:50:14.104 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-04-25T01:50:14.127 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-04-25T01:50:14.127 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-25T01:50:14.188 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-04-25T01:50:14.188 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-04-25T01:50:14.188 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-04-25T01:50:14.188 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:50:14.188 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-04-25T01:50:14.188 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-04-25T01:50:14.189 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-25T01:50:14.189 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-04-25T01:50:14.189 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-25T01:50:14.189 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:50:14.189 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:50:14.189 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-25T01:50:14.189 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:50:14.189 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-25T01:50:14.229 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T01:50:14.239 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T01:50:14.245 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T01:50:14.245 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:50:14.247 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:50:14.267 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T01:50:14.273 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T01:50:14.274 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:50:14.310 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:50:14.348 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T01:50:14.403 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T01:50:14.417 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-25T01:50:14.417 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-25T01:50:14.418 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-25T01:50:14.418 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:50:14.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:50:14.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2024-04-25T01:50:14.714 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T01:50:14.715 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T01:50:14.715 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-25T01:50:14.736 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-489.el8.x86_64 2024-04-25T01:50:14.737 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T01:50:14.737 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T01:50:14.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum upgrade -y linux-firmware 2024-04-25T01:50:19.450 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 13 MB/s | 28 MB 00:02 2024-04-25T01:50:25.541 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 9.0 MB/s | 10 MB 00:01 2024-04-25T01:50:27.608 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 38 kB/s | 18 kB 00:00 2024-04-25T01:50:28.125 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 7.7 kB 00:00 2024-04-25T01:50:28.569 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 9.8 kB/s | 3.5 kB 00:00 2024-04-25T01:50:44.952 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:16 2024-04-25T01:50:48.683 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 491 kB/s | 24 kB 00:00 2024-04-25T01:50:51.865 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-04-25T01:50:51.865 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 baseos 355 M 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 1 Package 2024-04-25T01:50:51.866 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T01:50:51.867 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 355 M 2024-04-25T01:50:51.867 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-04-25T01:51:43.105 INFO:teuthology.orchestra.run.smithi088.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 6.9 MB/s | 355 MB 00:51 2024-04-25T01:51:43.106 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:51:43.106 INFO:teuthology.orchestra.run.smithi088.stdout:Total 6.9 MB/s | 355 MB 00:51 2024-04-25T01:51:45.205 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-04-25T01:51:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-04-25T01:51:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-04-25T01:51:47.473 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-04-25T01:51:47.513 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-04-25T01:52:10.246 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-04-25T01:52:10.593 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-04-25T01:52:10.830 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-25T01:52:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-25T01:52:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-04-25T01:52:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-04-25T01:52:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T01:52:11.583 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-04-25T01:52:11.583 INFO:teuthology.orchestra.run.smithi088.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-04-25T01:52:11.584 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T01:52:11.584 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-04-25T01:52:11.808 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T01:52:11.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T01:52:12.035 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ 2024-04-25T01:52:12.035 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ --input-file=- 2024-04-25T01:52:12.038 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi088.front.sepia.ceph.com to complete... 2024-04-25T01:52:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25 01:52:31 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [425099368/425099368] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-25T01:52:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:FINISHED --2024-04-25 01:52:31-- 2024-04-25T01:52:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:Total wall clock time: 19s 2024-04-25T01:52:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:Downloaded: 1 files, 405M in 19s (21.8 MB/s) 2024-04-25T01:52:31.155 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T01:52:31.155 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-25T01:52:32.974 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying... ######################################## 2024-04-25T01:52:33.020 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing... ######################################## 2024-04-25T01:52:33.128 INFO:teuthology.orchestra.run.smithi088.stdout:Updating / installing... 2024-04-25T01:53:15.664 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-25T01:53:17.105 INFO:teuthology.orchestra.run.smithi088.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-25T01:53:39.698 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-25T01:53:39.698 DEBUG:teuthology.orchestra.run.smithi088:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-25T01:53:39.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T01:53:39.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T01:53:39.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T01:53:39.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T01:53:39.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T01:53:39.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T01:53:39.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T01:53:39.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T01:53:39.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-25T01:53:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T01:53:39.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T01:53:39.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-25T01:53:39.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T01:53:39.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-25T01:53:39.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-25T01:53:39.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-25T01:53:39.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T01:53:39.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T01:53:39.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T01:53:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T01:53:39.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T01:53:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T01:53:39.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T01:53:39.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T01:53:39.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T01:53:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T01:53:39.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T01:53:39.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T01:53:39.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T01:53:39.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T01:53:39.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T01:53:39.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T01:53:39.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T01:53:39.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T01:53:39.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T01:53:39.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T01:53:39.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T01:53:39.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-25T01:53:39.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T01:53:39.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T01:53:39.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T01:53:39.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T01:53:39.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T01:53:39.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T01:53:39.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T01:53:39.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-25T01:53:39.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T01:53:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T01:53:39.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T01:53:39.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T01:53:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-25T01:53:39.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T01:53:39.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-25T01:53:39.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T01:53:39.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-25T01:53:39.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T01:53:39.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T01:53:39.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T01:53:39.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T01:53:39.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-25T01:53:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T01:53:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-25T01:53:39.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-25T01:53:39.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T01:53:39.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T01:53:39.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T01:53:39.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T01:53:39.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T01:53:39.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-25T01:53:39.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T01:53:39.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T01:53:39.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T01:53:39.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T01:53:39.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-25T01:53:39.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T01:53:39.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-25T01:53:39.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-25T01:53:39.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T01:53:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-25T01:53:39.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T01:53:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T01:53:39.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T01:53:39.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T01:53:39.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T01:53:39.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-25T01:53:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T01:53:39.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T01:53:39.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-25T01:53:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T01:53:39.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T01:53:39.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-25T01:53:39.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-25T01:53:39.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-25T01:53:39.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T01:53:39.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T01:53:39.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-25T01:53:39.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T01:53:39.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T01:53:39.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T01:53:39.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T01:53:39.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T01:53:39.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T01:53:39.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T01:53:39.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T01:53:39.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T01:53:39.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T01:53:39.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T01:53:39.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T01:53:39.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T01:53:39.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T01:53:39.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T01:53:39.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T01:53:39.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-25T01:53:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T01:53:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T01:53:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T01:53:39.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T01:53:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T01:53:39.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T01:53:39.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T01:53:39.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T01:53:39.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T01:53:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T01:53:39.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T01:53:39.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T01:53:39.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T01:53:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T01:53:39.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T01:53:39.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T01:53:39.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T01:53:39.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T01:53:39.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T01:53:39.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T01:53:39.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T01:53:39.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T01:53:39.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T01:53:39.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T01:53:39.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T01:53:39.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T01:53:39.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T01:53:39.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T01:53:39.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T01:53:39.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T01:53:39.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T01:53:39.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T01:53:39.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T01:53:39.897 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T01:53:39.898 DEBUG:teuthology.orchestra.run.smithi088:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-25T01:53:39.923 INFO:teuthology.orchestra.run.smithi088.stdout:postinstall scriptlet (using /bin/sh): 2024-04-25T01:53:39.923 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T01:53:39.923 INFO:teuthology.orchestra.run.smithi088.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T01:53:39.923 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2024-04-25T01:53:39.923 INFO:teuthology.orchestra.run.smithi088.stdout:for file in vmlinuz System.map config; do 2024-04-25T01:53:39.923 INFO:teuthology.orchestra.run.smithi088.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-25T01:53:39.923 INFO:teuthology.orchestra.run.smithi088.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout: fi 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:done 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-25T01:53:39.924 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2024-04-25T01:53:39.925 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2024-04-25T01:53:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2024-04-25T01:53:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2024-04-25T01:53:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2024-04-25T01:53:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 129.el8 2024-04-25T01:53:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2024-04-25T01:53:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-25T01:53:40.004 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9265586 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : CentOS BuildSystem 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2024-04-25T01:53:40.005 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T01:53:40.006 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T01:53:40.006 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T01:53:40.006 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T01:53:40.006 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2024-04-25T01:53:40.006 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T01:53:40.006 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T01:53:40.007 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T01:53:40.007 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 6.9.0-rc3-g806ec36b2112 2024-04-25T01:53:40.007 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T01:53:44.082 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-04-25T01:53:46.299 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-04-25T01:53:46.301 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-04-25T01:53:46.333 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.liB0JD6zQW 2024-04-25T01:53:46.334 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.liB0JD6zQW 2024-04-25T01:53:46.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.liB0JD6zQW 2024-04-25T01:53:46.603 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.liB0JD6zQW is 6KB 2024-04-25T01:53:46.651 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.liB0JD6zQW 2024-04-25T01:53:46.668 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T01:53:46.747 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-25T01:53:46.747 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-25T01:53:46.748 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-25T01:53:46.748 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112.conf 2024-04-25T01:53:46.749 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112 2024-04-25T01:53:46.959 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-04-25T01:54:16.962 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T01:54:16.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-25T01:54:16.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:54:51.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-25T01:55:00.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-25T01:55:00.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:55:03.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-25T01:55:15.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-25T01:55:15.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:55:47.606 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-25T01:55:48.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-25T01:55:48.147 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T01:55:48.148 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-25T01:55:48.191 INFO:teuthology.orchestra.run.smithi088.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T01:55:48.191 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T01:55:48.191 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T01:55:48.192 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T01:55:49.195 DEBUG:teuthology.parallel:result is None 2024-04-25T01:55:49.195 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T01:55:49.203 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T01:55:49.203 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:55:49.206 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:55:49.251 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T01:55:49.258 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T01:55:49.264 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T01:55:49.264 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:55:49.269 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:55:49.354 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T01:55:49.361 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T01:55:49.361 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:55:49.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:55:49.382 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:55:49.425 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:55:49.470 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:55:49.487 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:55:49.555 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:55:49.590 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:55:49.593 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T01:55:49.600 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T01:55:49.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:55:49.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:55:49.673 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T01:55:49.682 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T01:55:49.683 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:55:49.685 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:55:49.729 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:55:49.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:55:49.843 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:55:49.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:55:49.977 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T01:55:49.977 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:55:50.047 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:55:50.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:55:50.217 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:55:50.287 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:55:50.373 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T01:55:50.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:55:50.440 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-04-25T01:55:50.442 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-04-25T01:55:50.519 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:55:50.623 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:55:50.974 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T01:55:50.982 INFO:teuthology.task.internal:Starting timer... 2024-04-25T01:55:50.982 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T01:55:50.992 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T01:55:51.000 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-25T01:55:51.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-04-25T01:55:51.060 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-04-25T01:55:51.062 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-04-25T01:55:51.167 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-04-25T01:55:51.171 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T01:55:51.171 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-04-25T01:55:51.193 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-04-25T01:55:51.193 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-04-25T01:55:51.248 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-04-25T01:55:51.249 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi088.front.sepia.ceph.com': 'permissive'} 2024-04-25T01:55:51.249 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T01:55:51.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:55:51.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T01:55:51.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:55:51.347 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T01:55:51.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:55:51.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:55:51.445 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T01:55:51.454 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T01:55:51.470 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T01:55:51.471 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi088.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T02:03:01.611 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi088.front.sepia.ceph.com')] 2024-04-25T02:03:01.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T02:03:01.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:03:01.693 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-25T02:03:01.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T02:03:01.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-25T02:03:01.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:03:01.852 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-25T02:03:01.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-25T02:03:01.974 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T02:03:01.986 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T02:03:01.986 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:03:01.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:03:01.989 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:03:01.989 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:03:02.026 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:03:02.042 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:03:02.085 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:03:02.117 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:03:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-04-25T02:03:02.131 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-04-25T02:03:02.146 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:03:02.161 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:03:02.203 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-04-25T02:03:02.229 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-04-25T02:03:02.239 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2024-04-25T02:03:02.243 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:03:02.243 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-04-25T02:03:02.243 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:03:02.244 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:03:02.244 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:03:02.244 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:03:02.260 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:03:02.291 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:03:02.377 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2024-04-25T02:03:02.384 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:03:02.385 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-04-25T02:03:02.385 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:03:02.385 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:03:02.385 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:03:02.385 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:03:02.386 INFO:teuthology.run_tasks:Running task install... 2024-04-25T02:03:02.394 DEBUG:teuthology.task.install:project ceph 2024-04-25T02:03:02.394 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T02:03:02.395 DEBUG:teuthology.task.install:config {'branch': 'nautilus', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T02:03:02.395 INFO:teuthology.task.install:Using flavor: default 2024-04-25T02:03:02.401 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T02:03:02.401 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2024-04-25T02:03:02.401 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:03:02.401 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:03:02.402 INFO:teuthology.packaging:ref: None 2024-04-25T02:03:02.402 INFO:teuthology.packaging:tag: None 2024-04-25T02:03:02.402 INFO:teuthology.packaging:branch: nautilus 2024-04-25T02:03:02.402 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:03:02.402 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-25T02:03:02.404 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:03:02.405 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:03:02.405 INFO:teuthology.packaging:ref: None 2024-04-25T02:03:02.405 INFO:teuthology.packaging:tag: None 2024-04-25T02:03:02.405 INFO:teuthology.packaging:branch: nautilus 2024-04-25T02:03:02.405 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:03:02.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-25T02:03:02.583 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2024-04-25T02:03:02.584 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2024-04-25T02:03:02.604 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2024-04-25T02:03:02.605 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2024-04-25T02:03:02.628 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:03:02.628 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:03:02.628 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:03:02.645 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:03:02.645 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:03:02.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:03:02.661 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2024-04-25T02:03:02.661 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:03:02.661 INFO:teuthology.packaging:ref: None 2024-04-25T02:03:02.661 INFO:teuthology.packaging:tag: None 2024-04-25T02:03:02.661 INFO:teuthology.packaging:branch: nautilus 2024-04-25T02:03:02.661 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:03:02.661 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:03:02.711 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2024-04-25T02:03:02.711 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:03:02.711 INFO:teuthology.packaging:ref: None 2024-04-25T02:03:02.711 INFO:teuthology.packaging:tag: None 2024-04-25T02:03:02.711 INFO:teuthology.packaging:branch: nautilus 2024-04-25T02:03:02.711 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:03:02.711 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:03:02.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:03:02.814 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:03:02.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:03:02.883 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-04-25T02:03:02.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-04-25T02:03:02.910 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:03:02.976 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2024-04-25T02:03:02.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2024-04-25T02:03:03.166 INFO:teuthology.orchestra.run.smithi057.stdout:78 files removed 2024-04-25T02:03:03.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2024-04-25T02:03:03.320 INFO:teuthology.orchestra.run.smithi088.stdout:78 files removed 2024-04-25T02:03:03.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2024-04-25T02:03:03.673 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 786 kB/s | 65 kB 00:00 2024-04-25T02:03:03.791 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 139 kB/s | 11 kB 00:00 2024-04-25T02:03:03.900 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 21 kB/s | 1.7 kB 00:00 2024-04-25T02:03:03.987 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 893 kB/s | 65 kB 00:00 2024-04-25T02:03:04.087 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 176 kB/s | 11 kB 00:00 2024-04-25T02:03:04.197 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 20 kB/s | 1.7 kB 00:00 2024-04-25T02:03:04.750 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - AppStream 34 MB/s | 28 MB 00:00 2024-04-25T02:03:04.939 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 39 MB/s | 28 MB 00:00 2024-04-25T02:03:10.667 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-04-25T02:03:11.006 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-25T02:03:12.918 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2024-04-25T02:03:13.264 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 32 kB/s | 18 kB 00:00 2024-04-25T02:03:13.277 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras common packages 32 kB/s | 7.7 kB 00:00 2024-04-25T02:03:13.782 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 7.7 kB 00:00 2024-04-25T02:03:18.970 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - PowerTools 908 kB/s | 5.0 MB 00:05 2024-04-25T02:03:19.508 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - PowerTools 902 kB/s | 5.0 MB 00:05 2024-04-25T02:03:20.105 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-25T02:03:20.625 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-25T02:03:21.661 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2024-04-25T02:03:21.675 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-04-25T02:03:25.764 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 415 kB/s | 24 kB 00:00 2024-04-25T02:03:26.103 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 374 kB/s | 24 kB 00:00 2024-04-25T02:03:29.649 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-25T02:03:29.649 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-25T02:03:29.667 INFO:teuthology.orchestra.run.smithi057.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-04-25T02:03:29.668 INFO:teuthology.orchestra.run.smithi057.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-04-25T02:03:29.669 INFO:teuthology.orchestra.run.smithi057.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-04-25T02:03:29.744 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================ 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================ 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:14.2.22-0.el8 ceph-noarch 3.7 M 2024-04-25T02:03:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:14.2.22-0.el8 ceph-noarch 1.1 M 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:14.2.22-0.el8 ceph-noarch 15 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2024-04-25T02:03:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-25T02:03:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-25T02:03:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-25T02:03:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-04-25T02:03:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-25T02:03:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-25T02:03:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-25T02:03:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:14.2.22-0.el8 ceph-noarch 24 k 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2024-04-25T02:03:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-25T02:03:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-25T02:03:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-25T02:03:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-25T02:03:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-25T02:03:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-25T02:03:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================ 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout:Install 102 Packages 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 19 Packages 2024-04-25T02:03:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:03:29.772 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 166 M 2024-04-25T02:03:29.772 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-25T02:03:29.864 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-25T02:03:29.865 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-25T02:03:29.883 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-04-25T02:03:29.884 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-04-25T02:03:29.885 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-04-25T02:03:29.959 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-04-25T02:03:29.982 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================ 2024-04-25T02:03:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-04-25T02:03:29.982 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================ 2024-04-25T02:03:29.982 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-04-25T02:03:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-25T02:03:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2024-04-25T02:03:29.982 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:14.2.22-0.el8 ceph-noarch 3.7 M 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:14.2.22-0.el8 ceph-noarch 1.1 M 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:14.2.22-0.el8 ceph-noarch 15 k 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2024-04-25T02:03:29.983 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-04-25T02:03:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-25T02:03:29.985 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-25T02:03:29.986 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-04-25T02:03:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2024-04-25T02:03:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:14.2.22-0.el8 ceph-noarch 24 k 2024-04-25T02:03:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2024-04-25T02:03:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2024-04-25T02:03:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2024-04-25T02:03:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2024-04-25T02:03:29.986 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-25T02:03:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-25T02:03:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-25T02:03:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-25T02:03:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-25T02:03:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-25T02:03:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-25T02:03:29.987 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-04-25T02:03:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-25T02:03:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-04-25T02:03:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-25T02:03:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2024-04-25T02:03:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-25T02:03:29.988 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2024-04-25T02:03:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-25T02:03:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-25T02:03:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-25T02:03:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-25T02:03:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-25T02:03:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-25T02:03:29.989 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-25T02:03:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-25T02:03:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-25T02:03:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-25T02:03:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-25T02:03:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-25T02:03:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-25T02:03:29.990 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-25T02:03:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-25T02:03:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2024-04-25T02:03:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-25T02:03:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-25T02:03:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-25T02:03:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-25T02:03:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-25T02:03:29.991 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-25T02:03:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-25T02:03:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-25T02:03:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-25T02:03:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-25T02:03:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-25T02:03:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-25T02:03:29.992 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-25T02:03:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-25T02:03:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-25T02:03:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-25T02:03:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-25T02:03:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-25T02:03:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-25T02:03:29.993 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-25T02:03:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-25T02:03:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-25T02:03:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-25T02:03:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-25T02:03:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-25T02:03:29.994 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-25T02:03:29.995 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================================ 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout:Install 102 Packages 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 19 Packages 2024-04-25T02:03:29.996 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:03:29.997 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 166 M 2024-04-25T02:03:29.997 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-04-25T02:03:30.596 INFO:teuthology.orchestra.run.smithi088.stdout:(1/121): ceph-14.2.22-0.el8.x86_64.rpm 100 kB/s | 6.3 kB 00:00 2024-04-25T02:03:30.646 INFO:teuthology.orchestra.run.smithi088.stdout:(2/121): ceph-fuse-14.2.22-0.el8.x86_64.rpm 12 MB/s | 590 kB 00:00 2024-04-25T02:03:30.721 INFO:teuthology.orchestra.run.smithi088.stdout:(3/121): ceph-mds-14.2.22-0.el8.x86_64.rpm 26 MB/s | 2.0 MB 00:00 2024-04-25T02:03:30.789 INFO:teuthology.orchestra.run.smithi088.stdout:(4/121): ceph-mgr-14.2.22-0.el8.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-25T02:03:30.872 INFO:teuthology.orchestra.run.smithi088.stdout:(5/121): ceph-base-14.2.22-0.el8.x86_64.rpm 16 MB/s | 5.4 MB 00:00 2024-04-25T02:03:31.014 INFO:teuthology.orchestra.run.smithi088.stdout:(6/121): ceph-mon-14.2.22-0.el8.x86_64.rpm 20 MB/s | 4.5 MB 00:00 2024-04-25T02:03:31.206 INFO:teuthology.orchestra.run.smithi088.stdout:(7/121): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 31 MB/s | 6.0 MB 00:00 2024-04-25T02:03:31.222 INFO:teuthology.orchestra.run.smithi088.stdout:(8/121): ceph-selinux-14.2.22-0.el8.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2024-04-25T02:03:31.449 INFO:teuthology.orchestra.run.smithi057.stdout:(1/121): ceph-14.2.22-0.el8.x86_64.rpm 131 kB/s | 6.3 kB 00:00 2024-04-25T02:03:31.482 INFO:teuthology.orchestra.run.smithi057.stdout:(2/121): ceph-fuse-14.2.22-0.el8.x86_64.rpm 17 MB/s | 590 kB 00:00 2024-04-25T02:03:31.489 INFO:teuthology.orchestra.run.smithi088.stdout:(9/121): ceph-common-14.2.22-0.el8.x86_64.rpm 20 MB/s | 19 MB 00:00 2024-04-25T02:03:31.515 INFO:teuthology.orchestra.run.smithi088.stdout:(10/121): libcephfs-devel-14.2.22-0.el8.x86_64. 873 kB/s | 22 kB 00:00 2024-04-25T02:03:31.557 INFO:teuthology.orchestra.run.smithi088.stdout:(11/121): libcephfs2-14.2.22-0.el8.x86_64.rpm 12 MB/s | 520 kB 00:00 2024-04-25T02:03:31.582 INFO:teuthology.orchestra.run.smithi088.stdout:(12/121): librados-devel-14.2.22-0.el8.x86_64.r 3.5 MB/s | 90 kB 00:00 2024-04-25T02:03:31.615 INFO:teuthology.orchestra.run.smithi088.stdout:(13/121): libradosstriper1-14.2.22-0.el8.x86_64 11 MB/s | 376 kB 00:00 2024-04-25T02:03:31.624 INFO:teuthology.orchestra.run.smithi057.stdout:(3/121): ceph-mds-14.2.22-0.el8.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-04-25T02:03:31.683 INFO:teuthology.orchestra.run.smithi057.stdout:(4/121): ceph-mgr-14.2.22-0.el8.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-04-25T02:03:31.767 INFO:teuthology.orchestra.run.smithi057.stdout:(5/121): ceph-base-14.2.22-0.el8.x86_64.rpm 15 MB/s | 5.4 MB 00:00 2024-04-25T02:03:31.832 INFO:teuthology.orchestra.run.smithi088.stdout:(14/121): ceph-osd-14.2.22-0.el8.x86_64.rpm 17 MB/s | 17 MB 00:00 2024-04-25T02:03:31.858 INFO:teuthology.orchestra.run.smithi088.stdout:(15/121): python3-ceph-argparse-14.2.22-0.el8.x 1.5 MB/s | 39 kB 00:00 2024-04-25T02:03:31.883 INFO:teuthology.orchestra.run.smithi088.stdout:(16/121): python3-cephfs-14.2.22-0.el8.x86_64.r 6.3 MB/s | 159 kB 00:00 2024-04-25T02:03:31.883 INFO:teuthology.orchestra.run.smithi057.stdout:(6/121): ceph-mon-14.2.22-0.el8.x86_64.rpm 22 MB/s | 4.5 MB 00:00 2024-04-25T02:03:31.918 INFO:teuthology.orchestra.run.smithi088.stdout:(17/121): python3-rados-14.2.22-0.el8.x86_64.rp 9.6 MB/s | 323 kB 00:00 2024-04-25T02:03:31.950 INFO:teuthology.orchestra.run.smithi088.stdout:(18/121): python3-rbd-14.2.22-0.el8.x86_64.rpm 8.5 MB/s | 291 kB 00:00 2024-04-25T02:03:31.976 INFO:teuthology.orchestra.run.smithi088.stdout:(19/121): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.4 MB/s | 113 kB 00:00 2024-04-25T02:03:32.001 INFO:teuthology.orchestra.run.smithi088.stdout:(20/121): rbd-fuse-14.2.22-0.el8.x86_64.rpm 2.9 MB/s | 73 kB 00:00 2024-04-25T02:03:32.026 INFO:teuthology.orchestra.run.smithi057.stdout:(7/121): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 42 MB/s | 6.0 MB 00:00 2024-04-25T02:03:32.050 INFO:teuthology.orchestra.run.smithi057.stdout:(8/121): ceph-selinux-14.2.22-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-25T02:03:32.102 INFO:teuthology.orchestra.run.smithi088.stdout:(21/121): rbd-mirror-14.2.22-0.el8.x86_64.rpm 23 MB/s | 2.3 MB 00:00 2024-04-25T02:03:32.127 INFO:teuthology.orchestra.run.smithi088.stdout:(22/121): rbd-nbd-14.2.22-0.el8.x86_64.rpm 5.6 MB/s | 142 kB 00:00 2024-04-25T02:03:32.152 INFO:teuthology.orchestra.run.smithi088.stdout:(23/121): ceph-grafana-dashboards-14.2.22-0.el8 963 kB/s | 24 kB 00:00 2024-04-25T02:03:32.236 INFO:teuthology.orchestra.run.smithi088.stdout:(24/121): librgw2-14.2.22-0.el8.x86_64.rpm 8.5 MB/s | 5.3 MB 00:00 2024-04-25T02:03:32.286 INFO:teuthology.orchestra.run.smithi057.stdout:(9/121): ceph-common-14.2.22-0.el8.x86_64.rpm 22 MB/s | 19 MB 00:00 2024-04-25T02:03:32.294 INFO:teuthology.orchestra.run.smithi088.stdout:(25/121): ceph-mgr-diskprediction-local-14.2.22 19 MB/s | 1.1 MB 00:00 2024-04-25T02:03:32.312 INFO:teuthology.orchestra.run.smithi057.stdout:(10/121): libcephfs-devel-14.2.22-0.el8.x86_64. 874 kB/s | 22 kB 00:00 2024-04-25T02:03:32.320 INFO:teuthology.orchestra.run.smithi088.stdout:(26/121): ceph-mgr-rook-14.2.22-0.el8.noarch.rp 613 kB/s | 15 kB 00:00 2024-04-25T02:03:32.345 INFO:teuthology.orchestra.run.smithi057.stdout:(11/121): libcephfs2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 520 kB 00:00 2024-04-25T02:03:32.395 INFO:teuthology.orchestra.run.smithi057.stdout:(12/121): librados-devel-14.2.22-0.el8.x86_64.r 1.8 MB/s | 90 kB 00:00 2024-04-25T02:03:32.412 INFO:teuthology.orchestra.run.smithi088.stdout:(27/121): ceph-mgr-dashboard-14.2.22-0.el8.noar 14 MB/s | 3.7 MB 00:00 2024-04-25T02:03:32.430 INFO:teuthology.orchestra.run.smithi057.stdout:(13/121): libradosstriper1-14.2.22-0.el8.x86_64 11 MB/s | 376 kB 00:00 2024-04-25T02:03:32.520 INFO:teuthology.orchestra.run.smithi088.stdout:(28/121): bison-3.0.4-10.el8.x86_64.rpm 3.4 MB/s | 688 kB 00:00 2024-04-25T02:03:32.562 INFO:teuthology.orchestra.run.smithi088.stdout:(29/121): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2024-04-25T02:03:32.587 INFO:teuthology.orchestra.run.smithi088.stdout:(30/121): jq-1.6-8.el8.x86_64.rpm 3.0 MB/s | 203 kB 00:00 2024-04-25T02:03:32.621 INFO:teuthology.orchestra.run.smithi057.stdout:(14/121): ceph-osd-14.2.22-0.el8.x86_64.rpm 20 MB/s | 17 MB 00:00 2024-04-25T02:03:32.638 INFO:teuthology.orchestra.run.smithi088.stdout:(31/121): librdkafka-1.6.1-1.el8.x86_64.rpm 8.8 MB/s | 677 kB 00:00 2024-04-25T02:03:32.663 INFO:teuthology.orchestra.run.smithi088.stdout:(32/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2024-04-25T02:03:32.673 INFO:teuthology.orchestra.run.smithi057.stdout:(15/121): python3-ceph-argparse-14.2.22-0.el8.x 769 kB/s | 39 kB 00:00 2024-04-25T02:03:32.689 INFO:teuthology.orchestra.run.smithi088.stdout:(33/121): oniguruma-6.8.2-3.el8.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T02:03:32.705 INFO:teuthology.orchestra.run.smithi057.stdout:(16/121): python3-cephfs-14.2.22-0.el8.x86_64.r 4.9 MB/s | 159 kB 00:00 2024-04-25T02:03:32.738 INFO:teuthology.orchestra.run.smithi057.stdout:(17/121): python3-rados-14.2.22-0.el8.x86_64.rp 9.6 MB/s | 323 kB 00:00 2024-04-25T02:03:32.772 INFO:teuthology.orchestra.run.smithi057.stdout:(18/121): python3-rbd-14.2.22-0.el8.x86_64.rpm 8.5 MB/s | 291 kB 00:00 2024-04-25T02:03:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:(19/121): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.4 MB/s | 113 kB 00:00 2024-04-25T02:03:32.814 INFO:teuthology.orchestra.run.smithi057.stdout:(20/121): rbd-fuse-14.2.22-0.el8.x86_64.rpm 4.4 MB/s | 73 kB 00:00 2024-04-25T02:03:32.881 INFO:teuthology.orchestra.run.smithi057.stdout:(21/121): rbd-mirror-14.2.22-0.el8.x86_64.rpm 35 MB/s | 2.3 MB 00:00 2024-04-25T02:03:32.982 INFO:teuthology.orchestra.run.smithi057.stdout:(22/121): librgw2-14.2.22-0.el8.x86_64.rpm 9.6 MB/s | 5.3 MB 00:00 2024-04-25T02:03:32.998 INFO:teuthology.orchestra.run.smithi057.stdout:(23/121): ceph-grafana-dashboards-14.2.22-0.el8 1.4 MB/s | 24 kB 00:00 2024-04-25T02:03:33.024 INFO:teuthology.orchestra.run.smithi057.stdout:(24/121): rbd-nbd-14.2.22-0.el8.x86_64.rpm 1.0 MB/s | 142 kB 00:00 2024-04-25T02:03:33.072 INFO:teuthology.orchestra.run.smithi088.stdout:(34/121): ceph-test-14.2.22-0.el8.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-04-25T02:03:33.074 INFO:teuthology.orchestra.run.smithi057.stdout:(25/121): ceph-mgr-diskprediction-local-14.2.22 23 MB/s | 1.1 MB 00:00 2024-04-25T02:03:33.091 INFO:teuthology.orchestra.run.smithi057.stdout:(26/121): ceph-mgr-rook-14.2.22-0.el8.noarch.rp 926 kB/s | 15 kB 00:00 2024-04-25T02:03:33.172 INFO:teuthology.orchestra.run.smithi088.stdout:(35/121): openblas-0.3.15-4.el8.x86_64.rpm 9.3 MB/s | 4.7 MB 00:00 2024-04-25T02:03:33.174 INFO:teuthology.orchestra.run.smithi057.stdout:(27/121): ceph-mgr-dashboard-14.2.22-0.el8.noar 21 MB/s | 3.7 MB 00:00 2024-04-25T02:03:33.273 INFO:teuthology.orchestra.run.smithi088.stdout:(36/121): openblas-threads-0.3.15-4.el8.x86_64. 8.3 MB/s | 4.9 MB 00:00 2024-04-25T02:03:33.274 INFO:teuthology.orchestra.run.smithi057.stdout:(28/121): bison-3.0.4-10.el8.x86_64.rpm 3.7 MB/s | 688 kB 00:00 2024-04-25T02:03:33.298 INFO:teuthology.orchestra.run.smithi088.stdout:(37/121): python3-markupsafe-0.23-19.el8.x86_64 310 kB/s | 39 kB 00:00 2024-04-25T02:03:33.317 INFO:teuthology.orchestra.run.smithi057.stdout:(29/121): jq-1.6-8.el8.x86_64.rpm 4.8 MB/s | 203 kB 00:00 2024-04-25T02:03:33.342 INFO:teuthology.orchestra.run.smithi057.stdout:(30/121): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2024-04-25T02:03:33.348 INFO:teuthology.orchestra.run.smithi088.stdout:(38/121): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2024-04-25T02:03:33.373 INFO:teuthology.orchestra.run.smithi088.stdout:(39/121): python3-mako-1.0.6-14.el8.noarch.rpm 522 kB/s | 157 kB 00:00 2024-04-25T02:03:33.376 INFO:teuthology.orchestra.run.smithi057.stdout:(31/121): librdkafka-1.6.1-1.el8.x86_64.rpm 11 MB/s | 677 kB 00:00 2024-04-25T02:03:33.399 INFO:teuthology.orchestra.run.smithi088.stdout:(40/121): python3-prettytable-0.7.2-14.el8.noar 877 kB/s | 44 kB 00:00 2024-04-25T02:03:33.401 INFO:teuthology.orchestra.run.smithi057.stdout:(32/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2024-04-25T02:03:33.426 INFO:teuthology.orchestra.run.smithi057.stdout:(33/121): oniguruma-6.8.2-3.el8.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T02:03:33.432 INFO:teuthology.orchestra.run.smithi088.stdout:(41/121): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2024-04-25T02:03:33.458 INFO:teuthology.orchestra.run.smithi088.stdout:(42/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2024-04-25T02:03:33.491 INFO:teuthology.orchestra.run.smithi088.stdout:(43/121): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2024-04-25T02:03:33.516 INFO:teuthology.orchestra.run.smithi088.stdout:(44/121): python3-pytz-2017.2-11.el8.noarch.rpm 978 kB/s | 57 kB 00:00 2024-04-25T02:03:33.583 INFO:teuthology.orchestra.run.smithi088.stdout:(45/121): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2024-04-25T02:03:33.585 INFO:teuthology.orchestra.run.smithi057.stdout:(34/121): openblas-0.3.15-4.el8.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2024-04-25T02:03:33.617 INFO:teuthology.orchestra.run.smithi088.stdout:(46/121): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2024-04-25T02:03:33.643 INFO:teuthology.orchestra.run.smithi088.stdout:(47/121): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-04-25T02:03:33.660 INFO:teuthology.orchestra.run.smithi088.stdout:(48/121): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-04-25T02:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout:(35/121): openblas-threads-0.3.15-4.el8.x86_64. 21 MB/s | 4.9 MB 00:00 2024-04-25T02:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout:(36/121): python3-mako-1.0.6-14.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2024-04-25T02:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout:(37/121): python3-markupsafe-0.23-19.el8.x86_64 928 kB/s | 39 kB 00:00 2024-04-25T02:03:33.893 INFO:teuthology.orchestra.run.smithi088.stdout:(49/121): python3-scipy-1.0.0-21.module_el8+762 35 MB/s | 14 MB 00:00 2024-04-25T02:03:33.918 INFO:teuthology.orchestra.run.smithi088.stdout:(50/121): elfutils-libelf-devel-0.190-2.el8.x86 226 kB/s | 62 kB 00:00 2024-04-25T02:03:33.944 INFO:teuthology.orchestra.run.smithi088.stdout:(51/121): fuse-2.9.7-19.el8.x86_64.rpm 293 kB/s | 83 kB 00:00 2024-04-25T02:03:34.019 INFO:teuthology.orchestra.run.smithi057.stdout:(38/121): ceph-test-14.2.22-0.el8.x86_64.rpm 18 MB/s | 35 MB 00:01 2024-04-25T02:03:34.027 INFO:teuthology.orchestra.run.smithi088.stdout:(52/121): keyutils-libs-devel-1.5.10-9.el8.x86_ 360 kB/s | 48 kB 00:00 2024-04-25T02:03:34.044 INFO:teuthology.orchestra.run.smithi057.stdout:(39/121): python3-numpy-f2py-1.14.3-10.el8.x86_ 658 kB/s | 225 kB 00:00 2024-04-25T02:03:34.053 INFO:teuthology.orchestra.run.smithi088.stdout:(53/121): libcom_err-devel-1.45.6-5.el8.x86_64. 356 kB/s | 39 kB 00:00 2024-04-25T02:03:34.078 INFO:teuthology.orchestra.run.smithi088.stdout:(54/121): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.4 MB/s | 561 kB 00:00 2024-04-25T02:03:34.153 INFO:teuthology.orchestra.run.smithi057.stdout:(40/121): python3-numpy-1.14.3-10.el8.x86_64.rp 7.8 MB/s | 3.7 MB 00:00 2024-04-25T02:03:34.179 INFO:teuthology.orchestra.run.smithi057.stdout:(41/121): python3-prettytable-0.7.2-14.el8.noar 277 kB/s | 44 kB 00:00 2024-04-25T02:03:34.204 INFO:teuthology.orchestra.run.smithi057.stdout:(42/121): python3-pyOpenSSL-19.0.0-1.el8.noarch 651 kB/s | 103 kB 00:00 2024-04-25T02:03:34.229 INFO:teuthology.orchestra.run.smithi057.stdout:(43/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2024-04-25T02:03:34.254 INFO:teuthology.orchestra.run.smithi057.stdout:(44/121): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2024-04-25T02:03:34.278 INFO:teuthology.orchestra.run.smithi088.stdout:(55/121): libquadmath-8.5.0-21.el8.x86_64.rpm 765 kB/s | 172 kB 00:00 2024-04-25T02:03:34.279 INFO:teuthology.orchestra.run.smithi057.stdout:(45/121): python3-pytz-2017.2-11.el8.noarch.rpm 756 kB/s | 57 kB 00:00 2024-04-25T02:03:34.303 INFO:teuthology.orchestra.run.smithi088.stdout:(56/121): librabbitmq-0.9.0-5.el8.x86_64.rpm 209 kB/s | 47 kB 00:00 2024-04-25T02:03:34.329 INFO:teuthology.orchestra.run.smithi088.stdout:(57/121): libgfortran-8.5.0-21.el8.x86_64.rpm 2.1 MB/s | 645 kB 00:00 2024-04-25T02:03:34.330 INFO:teuthology.orchestra.run.smithi057.stdout:(46/121): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2024-04-25T02:03:34.388 INFO:teuthology.orchestra.run.smithi057.stdout:(47/121): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-04-25T02:03:34.395 INFO:teuthology.orchestra.run.smithi088.stdout:(58/121): libsepol-devel-2.9-3.el8.x86_64.rpm 949 kB/s | 87 kB 00:00 2024-04-25T02:03:34.414 INFO:teuthology.orchestra.run.smithi057.stdout:(48/121): xmlstarlet-1.6.1-20.el8.x86_64.rpm 845 kB/s | 71 kB 00:00 2024-04-25T02:03:34.421 INFO:teuthology.orchestra.run.smithi088.stdout:(59/121): libverto-devel-0.3.2-2.el8.x86_64.rpm 197 kB/s | 18 kB 00:00 2024-04-25T02:03:34.446 INFO:teuthology.orchestra.run.smithi088.stdout:(60/121): libselinux-devel-2.9-8.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2024-04-25T02:03:34.496 INFO:teuthology.orchestra.run.smithi088.stdout:(61/121): libzstd-devel-1.4.4-1.el8.x86_64.rpm 436 kB/s | 44 kB 00:00 2024-04-25T02:03:34.622 INFO:teuthology.orchestra.run.smithi088.stdout:(62/121): pcre2-devel-10.32-3.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2024-04-25T02:03:34.647 INFO:teuthology.orchestra.run.smithi088.stdout:(63/121): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2024-04-25T02:03:34.661 INFO:teuthology.orchestra.run.smithi057.stdout:(49/121): python3-scipy-1.0.0-21.module_el8+762 33 MB/s | 14 MB 00:00 2024-04-25T02:03:34.689 INFO:teuthology.orchestra.run.smithi057.stdout:(50/121): elfutils-libelf-devel-0.190-2.el8.x86 207 kB/s | 62 kB 00:00 2024-04-25T02:03:34.714 INFO:teuthology.orchestra.run.smithi057.stdout:(51/121): fuse-2.9.7-19.el8.x86_64.rpm 277 kB/s | 83 kB 00:00 2024-04-25T02:03:34.780 INFO:teuthology.orchestra.run.smithi088.stdout:(64/121): openssl-devel-1.1.1k-12.el8.x86_64.rp 8.9 MB/s | 3.2 MB 00:00 2024-04-25T02:03:34.789 INFO:teuthology.orchestra.run.smithi057.stdout:(52/121): libcom_err-devel-1.45.6-5.el8.x86_64. 517 kB/s | 39 kB 00:00 2024-04-25T02:03:34.806 INFO:teuthology.orchestra.run.smithi088.stdout:(65/121): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2024-04-25T02:03:34.831 INFO:teuthology.orchestra.run.smithi088.stdout:(66/121): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2024-04-25T02:03:34.831 INFO:teuthology.orchestra.run.smithi057.stdout:(53/121): keyutils-libs-devel-1.5.10-9.el8.x86_ 283 kB/s | 48 kB 00:00 2024-04-25T02:03:34.873 INFO:teuthology.orchestra.run.smithi088.stdout:(67/121): python3-jwt-1.6.1-2.el8.noarch.rpm 637 kB/s | 43 kB 00:00 2024-04-25T02:03:34.932 INFO:teuthology.orchestra.run.smithi088.stdout:(68/121): python3-cryptography-3.2.1-7.el8.x86_ 4.2 MB/s | 641 kB 00:00 2024-04-25T02:03:34.939 INFO:teuthology.orchestra.run.smithi057.stdout:(54/121): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.2 MB/s | 561 kB 00:00 2024-04-25T02:03:34.957 INFO:teuthology.orchestra.run.smithi088.stdout:(69/121): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2024-04-25T02:03:34.982 INFO:teuthology.orchestra.run.smithi088.stdout:(70/121): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2024-04-25T02:03:34.990 INFO:teuthology.orchestra.run.smithi057.stdout:(55/121): libquadmath-8.5.0-21.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2024-04-25T02:03:35.007 INFO:teuthology.orchestra.run.smithi088.stdout:(71/121): python3-requests-oauthlib-1.0.0-1.el8 566 kB/s | 43 kB 00:00 2024-04-25T02:03:35.032 INFO:teuthology.orchestra.run.smithi057.stdout:(56/121): librabbitmq-0.9.0-5.el8.x86_64.rpm 510 kB/s | 47 kB 00:00 2024-04-25T02:03:35.041 INFO:teuthology.orchestra.run.smithi088.stdout:(72/121): zlib-devel-1.2.11-21.el8.x86_64.rpm 691 kB/s | 58 kB 00:00 2024-04-25T02:03:35.091 INFO:teuthology.orchestra.run.smithi057.stdout:(57/121): libgfortran-8.5.0-21.el8.x86_64.rpm 2.1 MB/s | 645 kB 00:00 2024-04-25T02:03:35.116 INFO:teuthology.orchestra.run.smithi057.stdout:(58/121): libselinux-devel-2.9-8.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2024-04-25T02:03:35.141 INFO:teuthology.orchestra.run.smithi057.stdout:(59/121): libsepol-devel-2.9-3.el8.x86_64.rpm 799 kB/s | 87 kB 00:00 2024-04-25T02:03:35.167 INFO:teuthology.orchestra.run.smithi057.stdout:(60/121): libverto-devel-0.3.2-2.el8.x86_64.rpm 239 kB/s | 18 kB 00:00 2024-04-25T02:03:35.226 INFO:teuthology.orchestra.run.smithi057.stdout:(61/121): libzstd-devel-1.4.4-1.el8.x86_64.rpm 398 kB/s | 44 kB 00:00 2024-04-25T02:03:35.233 INFO:teuthology.orchestra.run.smithi088.stdout:(73/121): liboath-2.6.2-3.el8.x86_64.rpm 307 kB/s | 59 kB 00:00 2024-04-25T02:03:35.258 INFO:teuthology.orchestra.run.smithi088.stdout:(74/121): leveldb-1.22-1.el8.x86_64.rpm 722 kB/s | 181 kB 00:00 2024-04-25T02:03:35.300 INFO:teuthology.orchestra.run.smithi088.stdout:(75/121): gperftools-libs-2.7-9.el8.x86_64.rpm 963 kB/s | 306 kB 00:00 2024-04-25T02:03:35.326 INFO:teuthology.orchestra.run.smithi088.stdout:(76/121): libunwind-1.3.1-3.el8.x86_64.rpm 812 kB/s | 75 kB 00:00 2024-04-25T02:03:35.342 INFO:teuthology.orchestra.run.smithi057.stdout:(62/121): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-04-25T02:03:35.352 INFO:teuthology.orchestra.run.smithi088.stdout:(77/121): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 473 kB/s | 44 kB 00:00 2024-04-25T02:03:35.376 INFO:teuthology.orchestra.run.smithi088.stdout:(78/121): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2024-04-25T02:03:35.392 INFO:teuthology.orchestra.run.smithi057.stdout:(63/121): pcre2-devel-10.32-3.el8.x86_64.rpm 2.6 MB/s | 605 kB 00:00 2024-04-25T02:03:35.402 INFO:teuthology.orchestra.run.smithi088.stdout:(79/121): python3-cachetools-3.1.1-4.el8.noarch 436 kB/s | 33 kB 00:00 2024-04-25T02:03:35.427 INFO:teuthology.orchestra.run.smithi088.stdout:(80/121): python3-certifi-2018.10.15-7.el8.noar 215 kB/s | 16 kB 00:00 2024-04-25T02:03:35.451 INFO:teuthology.orchestra.run.smithi057.stdout:(64/121): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2024-04-25T02:03:35.452 INFO:teuthology.orchestra.run.smithi088.stdout:(81/121): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2024-04-25T02:03:35.531 INFO:teuthology.orchestra.run.smithi088.stdout:(82/121): python3-google-auth-1.1.1-10.el8.noar 785 kB/s | 81 kB 00:00 2024-04-25T02:03:35.534 INFO:teuthology.orchestra.run.smithi057.stdout:(65/121): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.7 MB/s | 249 kB 00:00 2024-04-25T02:03:35.561 INFO:teuthology.orchestra.run.smithi088.stdout:(83/121): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-04-25T02:03:35.595 INFO:teuthology.orchestra.run.smithi088.stdout:(84/121): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2024-04-25T02:03:35.610 INFO:teuthology.orchestra.run.smithi057.stdout:(66/121): python3-cryptography-3.2.1-7.el8.x86_ 4.0 MB/s | 641 kB 00:00 2024-04-25T02:03:35.620 INFO:teuthology.orchestra.run.smithi088.stdout:(85/121): python3-jaraco-functools-2.0-4.el8.no 198 kB/s | 18 kB 00:00 2024-04-25T02:03:35.635 INFO:teuthology.orchestra.run.smithi057.stdout:(67/121): python3-jwt-1.6.1-2.el8.noarch.rpm 426 kB/s | 43 kB 00:00 2024-04-25T02:03:35.653 INFO:teuthology.orchestra.run.smithi088.stdout:(86/121): python3-logutils-0.3.5-11.el8.noarch. 836 kB/s | 49 kB 00:00 2024-04-25T02:03:35.687 INFO:teuthology.orchestra.run.smithi088.stdout:(87/121): python3-more-itertools-7.2.0-3.el8.no 877 kB/s | 59 kB 00:00 2024-04-25T02:03:35.693 INFO:teuthology.orchestra.run.smithi057.stdout:(68/121): openssl-devel-1.1.1k-12.el8.x86_64.rp 5.8 MB/s | 3.2 MB 00:00 2024-04-25T02:03:35.719 INFO:teuthology.orchestra.run.smithi057.stdout:(69/121): python3-oauthlib-2.1.0-1.el8.noarch.r 1.4 MB/s | 155 kB 00:00 2024-04-25T02:03:35.737 INFO:teuthology.orchestra.run.smithi088.stdout:(88/121): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2024-04-25T02:03:35.744 INFO:teuthology.orchestra.run.smithi057.stdout:(70/121): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2024-04-25T02:03:35.763 INFO:teuthology.orchestra.run.smithi088.stdout:(89/121): python3-portend-2.6-1.el8.noarch.rpm 208 kB/s | 16 kB 00:00 2024-04-25T02:03:35.800 INFO:teuthology.orchestra.run.smithi057.stdout:(71/121): python3-requests-oauthlib-1.0.0-1.el8 403 kB/s | 43 kB 00:00 2024-04-25T02:03:35.837 INFO:teuthology.orchestra.run.smithi057.stdout:(72/121): zlib-devel-1.2.11-21.el8.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-04-25T02:03:35.871 INFO:teuthology.orchestra.run.smithi088.stdout:(90/121): python3-kubernetes-11.0.0-6.el8.noarc 3.8 MB/s | 1.2 MB 00:00 2024-04-25T02:03:35.896 INFO:teuthology.orchestra.run.smithi088.stdout:(91/121): python3-repoze-lru-0.7-6.el8.noarch.r 212 kB/s | 34 kB 00:00 2024-04-25T02:03:35.922 INFO:teuthology.orchestra.run.smithi088.stdout:(92/121): python3-routes-2.4.1-12.el8.noarch.rp 1.2 MB/s | 196 kB 00:00 2024-04-25T02:03:35.947 INFO:teuthology.orchestra.run.smithi088.stdout:(93/121): python3-rsa-4.9-2.el8.noarch.rpm 849 kB/s | 64 kB 00:00 2024-04-25T02:03:35.972 INFO:teuthology.orchestra.run.smithi088.stdout:(94/121): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2024-04-25T02:03:35.998 INFO:teuthology.orchestra.run.smithi088.stdout:(95/121): python3-singledispatch-3.4.0.3-18.el8 316 kB/s | 24 kB 00:00 2024-04-25T02:03:36.023 INFO:teuthology.orchestra.run.smithi088.stdout:(96/121): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2024-04-25T02:03:36.048 INFO:teuthology.orchestra.run.smithi088.stdout:(97/121): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2024-04-25T02:03:36.082 INFO:teuthology.orchestra.run.smithi088.stdout:(98/121): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-04-25T02:03:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:(99/121): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2024-04-25T02:03:36.132 INFO:teuthology.orchestra.run.smithi088.stdout:(100/121): python3-websocket-client-0.56.0-5.el 730 kB/s | 61 kB 00:00 2024-04-25T02:03:36.158 INFO:teuthology.orchestra.run.smithi088.stdout:(101/121): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2024-04-25T02:03:36.183 INFO:teuthology.orchestra.run.smithi088.stdout:(102/121): python3-zc-lockfile-2.0-2.el8.noarch 303 kB/s | 23 kB 00:00 2024-04-25T02:03:36.242 INFO:teuthology.orchestra.run.smithi088.stdout:(103/121): librbd1-14.2.22-0.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2024-04-25T02:03:36.317 INFO:teuthology.orchestra.run.smithi088.stdout:(104/121): librados2-14.2.22-0.el8.x86_64.rpm 19 MB/s | 3.5 MB 00:00 2024-04-25T02:03:36.337 INFO:teuthology.orchestra.run.smithi057.stdout:(73/121): liboath-2.6.2-3.el8.x86_64.rpm 119 kB/s | 59 kB 00:00 2024-04-25T02:03:36.395 INFO:teuthology.orchestra.run.smithi057.stdout:(74/121): leveldb-1.22-1.el8.x86_64.rpm 304 kB/s | 181 kB 00:00 2024-04-25T02:03:36.421 INFO:teuthology.orchestra.run.smithi057.stdout:(75/121): gperftools-libs-2.7-9.el8.x86_64.rpm 453 kB/s | 306 kB 00:00 2024-04-25T02:03:36.425 INFO:teuthology.orchestra.run.smithi088.stdout:(105/121): NetworkManager-1.40.16-15.el8.x86_64 9.4 MB/s | 2.3 MB 00:00 2024-04-25T02:03:36.476 INFO:teuthology.orchestra.run.smithi088.stdout:(106/121): NetworkManager-team-1.40.16-15.el8.x 1.0 MB/s | 161 kB 00:00 2024-04-25T02:03:36.513 INFO:teuthology.orchestra.run.smithi057.stdout:(76/121): libunwind-1.3.1-3.el8.x86_64.rpm 428 kB/s | 75 kB 00:00 2024-04-25T02:03:36.538 INFO:teuthology.orchestra.run.smithi057.stdout:(77/121): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 307 kB/s | 44 kB 00:00 2024-04-25T02:03:36.551 INFO:teuthology.orchestra.run.smithi088.stdout:(107/121): NetworkManager-tui-1.40.16-15.el8.x8 2.8 MB/s | 356 kB 00:00 2024-04-25T02:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout:(78/121): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2024-04-25T02:03:36.576 INFO:teuthology.orchestra.run.smithi088.stdout:(108/121): elfutils-debuginfod-client-0.190-2.e 766 kB/s | 77 kB 00:00 2024-04-25T02:03:36.610 INFO:teuthology.orchestra.run.smithi088.stdout:(109/121): NetworkManager-libnm-1.40.16-15.el8. 5.2 MB/s | 1.9 MB 00:00 2024-04-25T02:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout:(79/121): python3-cachetools-3.1.1-4.el8.noarch 208 kB/s | 33 kB 00:00 2024-04-25T02:03:36.684 INFO:teuthology.orchestra.run.smithi088.stdout:(110/121): elfutils-libelf-0.190-2.el8.x86_64.r 1.7 MB/s | 233 kB 00:00 2024-04-25T02:03:36.688 INFO:teuthology.orchestra.run.smithi057.stdout:(80/121): python3-certifi-2018.10.15-7.el8.noar 108 kB/s | 16 kB 00:00 2024-04-25T02:03:36.711 INFO:teuthology.orchestra.run.smithi088.stdout:(111/121): elfutils-libs-0.190-2.el8.x86_64.rpm 2.2 MB/s | 305 kB 00:00 2024-04-25T02:03:36.722 INFO:teuthology.orchestra.run.smithi057.stdout:(81/121): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2024-04-25T02:03:36.761 INFO:teuthology.orchestra.run.smithi088.stdout:(112/121): iproute-6.2.0-5.el8.x86_64.rpm 5.5 MB/s | 854 kB 00:00 2024-04-25T02:03:36.803 INFO:teuthology.orchestra.run.smithi088.stdout:(113/121): libblkid-2.32.1-46.el8.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-04-25T02:03:36.828 INFO:teuthology.orchestra.run.smithi088.stdout:(114/121): libfdisk-2.32.1-46.el8.x86_64.rpm 2.1 MB/s | 254 kB 00:00 2024-04-25T02:03:36.831 INFO:teuthology.orchestra.run.smithi057.stdout:(82/121): python3-google-auth-1.1.1-10.el8.noar 572 kB/s | 81 kB 00:00 2024-04-25T02:03:36.848 INFO:teuthology.orchestra.run.smithi057.stdout:(83/121): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2024-04-25T02:03:36.861 INFO:teuthology.orchestra.run.smithi088.stdout:(115/121): libmount-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 237 kB 00:00 2024-04-25T02:03:36.920 INFO:teuthology.orchestra.run.smithi088.stdout:(116/121): libsmartcols-2.32.1-46.el8.x86_64.rp 1.5 MB/s | 180 kB 00:00 2024-04-25T02:03:36.937 INFO:teuthology.orchestra.run.smithi088.stdout:(117/121): libuuid-2.32.1-46.el8.x86_64.rpm 914 kB/s | 99 kB 00:00 2024-04-25T02:03:36.988 INFO:teuthology.orchestra.run.smithi088.stdout:(118/121): openssl-1.1.1k-12.el8.x86_64.rpm 5.7 MB/s | 738 kB 00:00 2024-04-25T02:03:36.989 INFO:teuthology.orchestra.run.smithi057.stdout:(84/121): python3-cherrypy-18.4.0-1.el8.noarch. 1.2 MB/s | 384 kB 00:00 2024-04-25T02:03:37.006 INFO:teuthology.orchestra.run.smithi057.stdout:(85/121): python3-jaraco-functools-2.0-4.el8.no 100 kB/s | 18 kB 00:00 2024-04-25T02:03:37.096 INFO:teuthology.orchestra.run.smithi088.stdout:(119/121): openssl-libs-1.1.1k-12.el8.x86_64.rp 8.4 MB/s | 1.5 MB 00:00 2024-04-25T02:03:37.121 INFO:teuthology.orchestra.run.smithi088.stdout:(120/121): util-linux-user-2.32.1-46.el8.x86_64 774 kB/s | 103 kB 00:00 2024-04-25T02:03:37.157 INFO:teuthology.orchestra.run.smithi057.stdout:(86/121): python3-more-itertools-7.2.0-3.el8.no 391 kB/s | 59 kB 00:00 2024-04-25T02:03:37.230 INFO:teuthology.orchestra.run.smithi088.stdout:(121/121): util-linux-2.32.1-46.el8.x86_64.rpm 8.9 MB/s | 2.6 MB 00:00 2024-04-25T02:03:37.233 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:03:37.233 INFO:teuthology.orchestra.run.smithi088.stdout:Total 23 MB/s | 166 MB 00:07 2024-04-25T02:03:37.240 INFO:teuthology.orchestra.run.smithi057.stdout:(87/121): python3-kubernetes-11.0.0-6.el8.noarc 3.0 MB/s | 1.2 MB 00:00 2024-04-25T02:03:37.257 INFO:teuthology.orchestra.run.smithi057.stdout:(88/121): python3-logutils-0.3.5-11.el8.noarch. 182 kB/s | 49 kB 00:00 2024-04-25T02:03:37.366 INFO:teuthology.orchestra.run.smithi057.stdout:(89/121): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2024-04-25T02:03:37.391 INFO:teuthology.orchestra.run.smithi057.stdout:(90/121): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2024-04-25T02:03:37.408 INFO:teuthology.orchestra.run.smithi057.stdout:(91/121): python3-repoze-lru-0.7-6.el8.noarch.r 224 kB/s | 34 kB 00:00 2024-04-25T02:03:37.533 INFO:teuthology.orchestra.run.smithi057.stdout:(92/121): python3-rsa-4.9-2.el8.noarch.rpm 453 kB/s | 64 kB 00:00 2024-04-25T02:03:37.550 INFO:teuthology.orchestra.run.smithi057.stdout:(93/121): python3-simplegeneric-0.8.1-17.el8.no 132 kB/s | 19 kB 00:00 2024-04-25T02:03:37.575 INFO:teuthology.orchestra.run.smithi057.stdout:(94/121): python3-routes-2.4.1-12.el8.noarch.rp 940 kB/s | 196 kB 00:00 2024-04-25T02:03:37.634 INFO:teuthology.orchestra.run.smithi057.stdout:(95/121): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2024-04-25T02:03:37.693 INFO:teuthology.orchestra.run.smithi057.stdout:(96/121): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2024-04-25T02:03:37.826 INFO:teuthology.orchestra.run.smithi057.stdout:(97/121): python3-tempora-1.14.1-5.el8.noarch.r 106 kB/s | 29 kB 00:00 2024-04-25T02:03:37.861 INFO:teuthology.orchestra.run.smithi057.stdout:(98/121): python3-waitress-1.4.3-1.el8.noarch.r 1.1 MB/s | 255 kB 00:00 2024-04-25T02:03:37.885 INFO:teuthology.orchestra.run.smithi057.stdout:(99/121): python3-webob-1.8.5-1.el8.1.noarch.rp 1.3 MB/s | 251 kB 00:00 2024-04-25T02:03:38.019 INFO:teuthology.orchestra.run.smithi057.stdout:(100/121): python3-websocket-client-0.56.0-5.el 319 kB/s | 61 kB 00:00 2024-04-25T02:03:38.036 INFO:teuthology.orchestra.run.smithi057.stdout:(101/121): python3-zc-lockfile-2.0-2.el8.noarch 153 kB/s | 23 kB 00:00 2024-04-25T02:03:38.061 INFO:teuthology.orchestra.run.smithi057.stdout:(102/121): python3-webtest-2.0.33-1.el8.noarch. 426 kB/s | 85 kB 00:00 2024-04-25T02:03:38.153 INFO:teuthology.orchestra.run.smithi057.stdout:(103/121): librbd1-14.2.22-0.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2024-04-25T02:03:38.212 INFO:teuthology.orchestra.run.smithi057.stdout:(104/121): librados2-14.2.22-0.el8.x86_64.rpm 18 MB/s | 3.5 MB 00:00 2024-04-25T02:03:38.554 INFO:teuthology.orchestra.run.smithi057.stdout:(105/121): NetworkManager-team-1.40.16-15.el8.x 471 kB/s | 161 kB 00:00 2024-04-25T02:03:38.728 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-04-25T02:03:38.812 INFO:teuthology.orchestra.run.smithi057.stdout:(106/121): NetworkManager-1.40.16-15.el8.x86_64 3.0 MB/s | 2.3 MB 00:00 2024-04-25T02:03:38.904 INFO:teuthology.orchestra.run.smithi057.stdout:(107/121): NetworkManager-libnm-1.40.16-15.el8. 2.5 MB/s | 1.9 MB 00:00 2024-04-25T02:03:38.954 INFO:teuthology.orchestra.run.smithi057.stdout:(108/121): elfutils-debuginfod-client-0.190-2.e 541 kB/s | 77 kB 00:00 2024-04-25T02:03:39.030 INFO:teuthology.orchestra.run.smithi057.stdout:(109/121): NetworkManager-tui-1.40.16-15.el8.x8 748 kB/s | 356 kB 00:00 2024-04-25T02:03:39.033 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-04-25T02:03:39.033 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-04-25T02:03:39.055 INFO:teuthology.orchestra.run.smithi057.stdout:(110/121): elfutils-libelf-0.190-2.el8.x86_64.r 1.5 MB/s | 233 kB 00:00 2024-04-25T02:03:39.080 INFO:teuthology.orchestra.run.smithi057.stdout:(111/121): elfutils-libs-0.190-2.el8.x86_64.rpm 2.4 MB/s | 305 kB 00:00 2024-04-25T02:03:39.164 INFO:teuthology.orchestra.run.smithi057.stdout:(112/121): libblkid-2.32.1-46.el8.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-25T02:03:39.243 INFO:teuthology.orchestra.run.smithi057.stdout:(113/121): libfdisk-2.32.1-46.el8.x86_64.rpm 1.5 MB/s | 254 kB 00:00 2024-04-25T02:03:39.298 INFO:teuthology.orchestra.run.smithi057.stdout:(114/121): libmount-2.32.1-46.el8.x86_64.rpm 1.7 MB/s | 237 kB 00:00 2024-04-25T02:03:39.373 INFO:teuthology.orchestra.run.smithi057.stdout:(115/121): libsmartcols-2.32.1-46.el8.x86_64.rp 1.4 MB/s | 180 kB 00:00 2024-04-25T02:03:39.398 INFO:teuthology.orchestra.run.smithi057.stdout:(116/121): libuuid-2.32.1-46.el8.x86_64.rpm 993 kB/s | 99 kB 00:00 2024-04-25T02:03:39.607 INFO:teuthology.orchestra.run.smithi057.stdout:(117/121): openssl-1.1.1k-12.el8.x86_64.rpm 3.1 MB/s | 738 kB 00:00 2024-04-25T02:03:39.682 INFO:teuthology.orchestra.run.smithi057.stdout:(118/121): iproute-6.2.0-5.el8.x86_64.rpm 1.3 MB/s | 854 kB 00:00 2024-04-25T02:03:39.716 INFO:teuthology.orchestra.run.smithi057.stdout:(119/121): openssl-libs-1.1.1k-12.el8.x86_64.rp 4.6 MB/s | 1.5 MB 00:00 2024-04-25T02:03:39.824 INFO:teuthology.orchestra.run.smithi057.stdout:(120/121): util-linux-user-2.32.1-46.el8.x86_64 727 kB/s | 103 kB 00:00 2024-04-25T02:03:40.041 INFO:teuthology.orchestra.run.smithi057.stdout:(121/121): util-linux-2.32.1-46.el8.x86_64.rpm 6.0 MB/s | 2.6 MB 00:00 2024-04-25T02:03:40.046 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:03:40.047 INFO:teuthology.orchestra.run.smithi057.stdout:Total 16 MB/s | 166 MB 00:10 2024-04-25T02:03:40.362 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-04-25T02:03:40.366 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-04-25T02:03:40.860 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-25T02:03:41.145 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-25T02:03:41.145 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-25T02:03:42.201 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-25T02:03:42.204 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-25T02:03:44.971 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-04-25T02:03:45.182 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-25T02:03:45.413 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/140 2024-04-25T02:03:45.507 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/140 2024-04-25T02:03:45.693 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/140 2024-04-25T02:03:45.938 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/140 2024-04-25T02:03:46.104 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 4/140 2024-04-25T02:03:46.249 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 5/140 2024-04-25T02:03:46.336 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 5/140 2024-04-25T02:03:46.558 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 6/140 2024-04-25T02:03:46.678 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 6/140 2024-04-25T02:03:46.904 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 7/140 2024-04-25T02:03:47.116 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/140 2024-04-25T02:03:47.544 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/140 2024-04-25T02:03:47.684 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-25T02:03:47.766 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 9/140 2024-04-25T02:03:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-25T02:03:48.026 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 9/140 2024-04-25T02:03:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/140 2024-04-25T02:03:48.282 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 10/140 2024-04-25T02:03:48.309 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/140 2024-04-25T02:03:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 10/140 2024-04-25T02:03:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/140 2024-04-25T02:03:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 11/140 2024-04-25T02:03:48.693 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 11/140 2024-04-25T02:03:48.710 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/140 2024-04-25T02:03:48.918 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 4/140 2024-04-25T02:03:49.063 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 5/140 2024-04-25T02:03:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 5/140 2024-04-25T02:03:49.355 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 6/140 2024-04-25T02:03:49.357 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 12/140 2024-04-25T02:03:49.476 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 6/140 2024-04-25T02:03:49.507 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 13/140 2024-04-25T02:03:49.602 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 13/140 2024-04-25T02:03:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 7/140 2024-04-25T02:03:49.830 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/140 2024-04-25T02:03:49.838 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/140 2024-04-25T02:03:50.049 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/140 2024-04-25T02:03:50.198 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 16/140 2024-04-25T02:03:50.214 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/140 2024-04-25T02:03:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 9/140 2024-04-25T02:03:50.580 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 16/140 2024-04-25T02:03:50.650 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 9/140 2024-04-25T02:03:50.848 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 17/140 2024-04-25T02:03:50.920 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 17/140 2024-04-25T02:03:50.971 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 10/140 2024-04-25T02:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 10/140 2024-04-25T02:03:51.194 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-04-25T02:03:51.263 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 11/140 2024-04-25T02:03:51.336 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 11/140 2024-04-25T02:03:51.420 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-04-25T02:03:51.902 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-04-25T02:03:52.017 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 12/140 2024-04-25T02:03:52.131 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/140 2024-04-25T02:03:52.187 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 13/140 2024-04-25T02:03:52.293 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 13/140 2024-04-25T02:03:52.322 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/140 2024-04-25T02:03:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 21/140 2024-04-25T02:03:52.512 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/140 2024-04-25T02:03:52.626 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 21/140 2024-04-25T02:03:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/140 2024-04-25T02:03:52.823 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 22/140 2024-04-25T02:03:52.912 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 16/140 2024-04-25T02:03:53.185 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 16/140 2024-04-25T02:03:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 17/140 2024-04-25T02:03:53.474 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 22/140 2024-04-25T02:03:53.496 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 17/140 2024-04-25T02:03:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/140 2024-04-25T02:03:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-04-25T02:03:54.014 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-04-25T02:03:54.338 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/140 2024-04-25T02:03:54.401 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 18/140 2024-04-25T02:03:54.514 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/140 2024-04-25T02:03:54.669 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/140 2024-04-25T02:03:54.876 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/140 2024-04-25T02:03:55.004 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 21/140 2024-04-25T02:03:55.138 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 21/140 2024-04-25T02:03:55.287 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 22/140 2024-04-25T02:03:55.485 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/140 2024-04-25T02:03:55.856 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/140 2024-04-25T02:03:55.911 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 22/140 2024-04-25T02:03:56.086 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/140 2024-04-25T02:03:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/140 2024-04-25T02:03:56.232 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 27/140 2024-04-25T02:03:56.524 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 28/140 2024-04-25T02:03:56.722 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/140 2024-04-25T02:03:56.764 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/140 2024-04-25T02:03:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/140 2024-04-25T02:03:57.695 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/140 2024-04-25T02:03:58.061 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/140 2024-04-25T02:03:58.275 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/140 2024-04-25T02:03:58.454 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 27/140 2024-04-25T02:03:58.714 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 28/140 2024-04-25T02:03:58.757 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/140 2024-04-25T02:03:59.078 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/140 2024-04-25T02:03:59.091 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 30/140 2024-04-25T02:03:59.278 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/140 2024-04-25T02:03:59.484 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/140 2024-04-25T02:03:59.840 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 33/140 2024-04-25T02:04:00.057 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 34/140 2024-04-25T02:04:00.246 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 35/140 2024-04-25T02:04:00.410 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 36/140 2024-04-25T02:04:00.623 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 37/140 2024-04-25T02:04:00.796 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 38/140 2024-04-25T02:04:00.910 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 38/140 2024-04-25T02:04:00.949 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/140 2024-04-25T02:04:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 39/140 2024-04-25T02:04:01.218 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 39/140 2024-04-25T02:04:01.325 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 30/140 2024-04-25T02:04:01.455 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 40/140 2024-04-25T02:04:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/140 2024-04-25T02:04:01.667 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 41/140 2024-04-25T02:04:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/140 2024-04-25T02:04:01.837 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 42/140 2024-04-25T02:04:01.948 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 33/140 2024-04-25T02:04:02.171 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 34/140 2024-04-25T02:04:02.397 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 35/140 2024-04-25T02:04:02.401 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 42/140 2024-04-25T02:04:02.610 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 36/140 2024-04-25T02:04:02.646 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 43/140 2024-04-25T02:04:02.674 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 43/140 2024-04-25T02:04:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 37/140 2024-04-25T02:04:02.861 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 44/140 2024-04-25T02:04:03.002 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 38/140 2024-04-25T02:04:03.068 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 38/140 2024-04-25T02:04:03.127 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 45/140 2024-04-25T02:04:03.286 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 39/140 2024-04-25T02:04:03.370 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 46/140 2024-04-25T02:04:03.418 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 39/140 2024-04-25T02:04:03.550 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 47/140 2024-04-25T02:04:03.652 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 40/140 2024-04-25T02:04:03.699 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 48/140 2024-04-25T02:04:03.892 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 49/140 2024-04-25T02:04:04.016 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 41/140 2024-04-25T02:04:04.083 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 50/140 2024-04-25T02:04:04.186 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 42/140 2024-04-25T02:04:04.240 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 51/140 2024-04-25T02:04:04.410 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 52/140 2024-04-25T02:04:04.579 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 53/140 2024-04-25T02:04:04.672 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 42/140 2024-04-25T02:04:04.755 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/140 2024-04-25T02:04:04.953 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 43/140 2024-04-25T02:04:04.968 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 43/140 2024-04-25T02:04:05.165 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 44/140 2024-04-25T02:04:05.388 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/140 2024-04-25T02:04:05.410 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 45/140 2024-04-25T02:04:05.626 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 46/140 2024-04-25T02:04:05.676 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/140 2024-04-25T02:04:05.799 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 47/140 2024-04-25T02:04:05.911 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/140 2024-04-25T02:04:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 48/140 2024-04-25T02:04:06.155 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/140 2024-04-25T02:04:06.173 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 49/140 2024-04-25T02:04:06.386 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 59/140 2024-04-25T02:04:06.432 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 50/140 2024-04-25T02:04:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 60/140 2024-04-25T02:04:06.639 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 51/140 2024-04-25T02:04:06.792 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 52/140 2024-04-25T02:04:06.866 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/140 2024-04-25T02:04:06.986 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 53/140 2024-04-25T02:04:07.144 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/140 2024-04-25T02:04:07.283 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 62/140 2024-04-25T02:04:07.363 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/140 2024-04-25T02:04:07.560 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 63/140 2024-04-25T02:04:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/140 2024-04-25T02:04:07.733 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 64/140 2024-04-25T02:04:07.873 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/140 2024-04-25T02:04:07.996 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 65/140 2024-04-25T02:04:08.129 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/140 2024-04-25T02:04:08.203 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 66/140 2024-04-25T02:04:08.340 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 59/140 2024-04-25T02:04:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 60/140 2024-04-25T02:04:08.802 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/140 2024-04-25T02:04:09.239 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 62/140 2024-04-25T02:04:09.456 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 63/140 2024-04-25T02:04:09.468 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 67/140 2024-04-25T02:04:09.680 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 64/140 2024-04-25T02:04:09.696 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 68/140 2024-04-25T02:04:09.906 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 69/140 2024-04-25T02:04:10.047 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 65/140 2024-04-25T02:04:10.105 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 70/140 2024-04-25T02:04:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 66/140 2024-04-25T02:04:10.401 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/140 2024-04-25T02:04:10.661 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 72/140 2024-04-25T02:04:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 73/140 2024-04-25T02:04:11.191 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 74/140 2024-04-25T02:04:11.313 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 75/140 2024-04-25T02:04:11.458 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 67/140 2024-04-25T02:04:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 76/140 2024-04-25T02:04:11.718 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 68/140 2024-04-25T02:04:11.794 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 77/140 2024-04-25T02:04:11.966 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 69/140 2024-04-25T02:04:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 78/140 2024-04-25T02:04:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 70/140 2024-04-25T02:04:12.192 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 79/140 2024-04-25T02:04:12.389 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/140 2024-04-25T02:04:12.401 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 80/140 2024-04-25T02:04:12.589 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 72/140 2024-04-25T02:04:12.646 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 81/140 2024-04-25T02:04:12.847 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-19.el8.x86_64 82/140 2024-04-25T02:04:12.913 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 73/140 2024-04-25T02:04:13.062 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 83/140 2024-04-25T02:04:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 74/140 2024-04-25T02:04:13.225 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 84/140 2024-04-25T02:04:13.303 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 75/140 2024-04-25T02:04:13.442 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 85/140 2024-04-25T02:04:13.484 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 76/140 2024-04-25T02:04:13.755 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 86/140 2024-04-25T02:04:13.812 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 77/140 2024-04-25T02:04:14.004 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 87/140 2024-04-25T02:04:14.014 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 78/140 2024-04-25T02:04:14.160 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 88/140 2024-04-25T02:04:14.224 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 79/140 2024-04-25T02:04:14.431 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 80/140 2024-04-25T02:04:14.628 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 81/140 2024-04-25T02:04:14.862 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.7-19.el8.x86_64 82/140 2024-04-25T02:04:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 83/140 2024-04-25T02:04:15.305 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 84/140 2024-04-25T02:04:15.515 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 85/140 2024-04-25T02:04:15.819 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-2.6-1.el8.noarch 86/140 2024-04-25T02:04:16.062 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 87/140 2024-04-25T02:04:16.251 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 88/140 2024-04-25T02:04:16.406 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-04-25T02:04:16.652 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-04-25T02:04:17.364 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-04-25T02:04:17.657 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 90/140 2024-04-25T02:04:17.841 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 90/140 2024-04-25T02:04:18.017 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 91/140 2024-04-25T02:04:18.492 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-04-25T02:04:18.751 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-04-25T02:04:19.402 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 89/140 2024-04-25T02:04:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 90/140 2024-04-25T02:04:20.053 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 90/140 2024-04-25T02:04:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 91/140 2024-04-25T02:04:39.313 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 91/140 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2024-04-25T02:04:39.314 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:04:39.688 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 92/140 2024-04-25T02:04:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 92/140 2024-04-25T02:04:40.280 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 93/140 2024-04-25T02:04:40.404 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 91/140 2024-04-25T02:04:40.404 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /run 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2024-04-25T02:04:40.405 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:04:40.789 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 92/140 2024-04-25T02:04:41.196 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 92/140 2024-04-25T02:04:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 93/140 2024-04-25T02:04:41.751 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 93/140 2024-04-25T02:04:41.976 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 94/140 2024-04-25T02:04:42.041 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 94/140 2024-04-25T02:04:42.302 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 95/140 2024-04-25T02:04:42.671 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 96/140 2024-04-25T02:04:42.847 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 93/140 2024-04-25T02:04:42.975 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/140 2024-04-25T02:04:43.115 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 94/140 2024-04-25T02:04:43.120 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 98/140 2024-04-25T02:04:43.151 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 94/140 2024-04-25T02:04:43.217 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 98/140 2024-04-25T02:04:43.412 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-8.el8.x86_64 99/140 2024-04-25T02:04:43.412 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 95/140 2024-04-25T02:04:43.783 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 96/140 2024-04-25T02:04:44.101 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/140 2024-04-25T02:04:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 98/140 2024-04-25T02:04:44.373 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 98/140 2024-04-25T02:04:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 100/140 2024-04-25T02:04:44.588 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-8.el8.x86_64 99/140 2024-04-25T02:04:44.725 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 101/140 2024-04-25T02:04:45.094 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 101/140 2024-04-25T02:04:45.278 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 102/140 2024-04-25T02:04:45.306 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 102/140 2024-04-25T02:04:45.461 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:14.2.22-0.el8.noarch 103/140 2024-04-25T02:04:45.584 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 100/140 2024-04-25T02:04:45.687 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:14.2.22-0.el8.noarch 103/140 2024-04-25T02:04:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 101/140 2024-04-25T02:04:45.950 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 104/140 2024-04-25T02:04:45.991 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 104/140 2024-04-25T02:04:46.228 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 101/140 2024-04-25T02:04:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 102/140 2024-04-25T02:04:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 102/140 2024-04-25T02:04:46.596 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:14.2.22-0.el8.noarch 103/140 2024-04-25T02:04:46.798 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:14.2.22-0.el8.noarch 103/140 2024-04-25T02:04:47.189 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 104/140 2024-04-25T02:04:47.209 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 104/140 2024-04-25T02:04:49.335 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 105/140 2024-04-25T02:04:50.135 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 106/140 2024-04-25T02:04:50.365 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 107/140 2024-04-25T02:04:50.515 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 105/140 2024-04-25T02:04:50.620 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 107/140 2024-04-25T02:04:50.836 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 108/140 2024-04-25T02:04:50.930 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 108/140 2024-04-25T02:04:51.257 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 106/140 2024-04-25T02:04:51.480 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 107/140 2024-04-25T02:04:51.712 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 107/140 2024-04-25T02:04:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 108/140 2024-04-25T02:04:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 108/140 2024-04-25T02:04:52.117 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 109/140 2024-04-25T02:04:52.424 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 110/140 2024-04-25T02:04:52.608 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 111/140 2024-04-25T02:04:52.779 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 112/140 2024-04-25T02:04:52.860 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 109/140 2024-04-25T02:04:52.955 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 113/140 2024-04-25T02:04:53.157 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 114/140 2024-04-25T02:04:53.166 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 110/140 2024-04-25T02:04:53.375 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 115/140 2024-04-25T02:04:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 111/140 2024-04-25T02:04:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 116/140 2024-04-25T02:04:53.681 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 112/140 2024-04-25T02:04:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 113/140 2024-04-25T02:04:53.904 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 117/140 2024-04-25T02:04:54.060 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 114/140 2024-04-25T02:04:54.253 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 115/140 2024-04-25T02:04:54.268 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 118/140 2024-04-25T02:04:54.425 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 116/140 2024-04-25T02:04:54.577 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 119/140 2024-04-25T02:04:54.731 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 117/140 2024-04-25T02:04:54.809 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/140 2024-04-25T02:04:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/140 2024-04-25T02:04:55.069 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 118/140 2024-04-25T02:04:55.159 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/140 2024-04-25T02:04:55.184 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/140 2024-04-25T02:04:55.345 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 122/140 2024-04-25T02:04:55.350 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 119/140 2024-04-25T02:04:55.552 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/140 2024-04-25T02:04:55.553 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/140 2024-04-25T02:04:55.633 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/140 2024-04-25T02:04:55.727 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/140 2024-04-25T02:04:55.910 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 125/140 2024-04-25T02:04:55.911 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/140 2024-04-25T02:04:55.911 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/140 2024-04-25T02:04:55.924 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/140 2024-04-25T02:04:56.096 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 122/140 2024-04-25T02:04:56.179 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/140 2024-04-25T02:04:56.179 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/140 2024-04-25T02:04:56.313 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/140 2024-04-25T02:04:56.457 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/140 2024-04-25T02:04:56.459 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/140 2024-04-25T02:04:56.653 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/140 2024-04-25T02:04:56.663 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 125/140 2024-04-25T02:04:56.663 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/140 2024-04-25T02:04:56.860 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/140 2024-04-25T02:04:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/140 2024-04-25T02:04:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/140 2024-04-25T02:04:57.077 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/140 2024-04-25T02:04:57.078 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/140 2024-04-25T02:04:57.184 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/140 2024-04-25T02:04:57.292 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/140 2024-04-25T02:04:57.293 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/140 2024-04-25T02:04:57.330 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/140 2024-04-25T02:04:57.504 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/140 2024-04-25T02:04:57.504 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/140 2024-04-25T02:04:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/140 2024-04-25T02:04:57.747 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/140 2024-04-25T02:04:57.747 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/140 2024-04-25T02:04:57.747 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/140 2024-04-25T02:04:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 134/140 2024-04-25T02:04:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-04-25T02:04:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-04-25T02:04:57.981 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/140 2024-04-25T02:04:57.981 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/140 2024-04-25T02:04:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/140 2024-04-25T02:04:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/140 2024-04-25T02:04:58.385 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-04-25T02:04:58.385 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 136/140 2024-04-25T02:04:58.397 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/140 2024-04-25T02:04:58.547 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 134/140 2024-04-25T02:04:58.557 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-04-25T02:04:58.558 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-04-25T02:04:58.620 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 136/140 2024-04-25T02:04:58.620 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 137/140 2024-04-25T02:04:58.869 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 137/140 2024-04-25T02:04:58.870 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 138/140 2024-04-25T02:04:58.991 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 135/140 2024-04-25T02:04:58.991 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 136/140 2024-04-25T02:04:59.061 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 138/140 2024-04-25T02:04:59.211 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 139/140 2024-04-25T02:04:59.211 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 140/140 2024-04-25T02:04:59.230 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 136/140 2024-04-25T02:04:59.230 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 137/140 2024-04-25T02:04:59.455 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 137/140 2024-04-25T02:04:59.455 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 138/140 2024-04-25T02:04:59.638 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 138/140 2024-04-25T02:04:59.702 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 140/140 2024-04-25T02:04:59.702 INFO:teuthology.orchestra.run.smithi088.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-25T02:04:59.702 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:04:59.805 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 139/140 2024-04-25T02:04:59.805 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 140/140 2024-04-25T02:05:00.420 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 2/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 3/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 4/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 5/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 6/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 7/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 8/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 9/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 10/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 11/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 12/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 13/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 14/140 2024-04-25T02:05:00.421 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 15/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 16/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 17/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 18/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 19/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 20/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 21/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 22/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 23/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 24/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 25/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 26/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 27/140 2024-04-25T02:05:00.422 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:14.2.22-0.el8.noarch 28/140 2024-04-25T02:05:00.423 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.0.4-10.el8.x86_64 29/140 2024-04-25T02:05:00.423 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.1-9.el8.x86_64 30/140 2024-04-25T02:05:00.423 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-8.el8.x86_64 31/140 2024-04-25T02:05:00.423 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 32/140 2024-04-25T02:05:00.423 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 33/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 34/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 35/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 36/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 37/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 38/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 39/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 41/140 2024-04-25T02:05:00.433 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 42/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 43/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 44/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 45/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 46/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 47/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 48/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 49/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 50/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 51/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 53/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 54/140 2024-04-25T02:05:00.434 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 55/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 56/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 57/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 58/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 59/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 60/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 61/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 62/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 63/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 64/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 65/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 66/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 67/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 68/140 2024-04-25T02:05:00.435 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 69/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 70/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 72/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 73/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : leveldb-1.22-1.el8.x86_64 74/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 75/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 76/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 79/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 80/140 2024-04-25T02:05:00.436 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 81/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 82/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 83/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 84/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 85/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 86/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 87/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 88/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 89/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 90/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 91/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 92/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 93/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 94/140 2024-04-25T02:05:00.437 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 95/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 96/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 97/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 98/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 99/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 100/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 101/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 102/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 103/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 104/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 105/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 106/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 107/140 2024-04-25T02:05:00.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 108/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 109/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 110/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 111/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 112/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 113/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 114/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 115/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 117/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 119/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/140 2024-04-25T02:05:00.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 123/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 125/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 127/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 129/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 131/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 133/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 134/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 135/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 136/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 137/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 138/140 2024-04-25T02:05:00.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 139/140 2024-04-25T02:05:00.630 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 140/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 2/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 3/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 4/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 5/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 6/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 7/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 8/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 9/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 10/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 11/140 2024-04-25T02:05:00.631 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 12/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 13/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 14/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 15/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 16/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 17/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 18/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 19/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 20/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 21/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 22/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 23/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 24/140 2024-04-25T02:05:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 25/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 26/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:14.2.22-0.el8.no 27/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:14.2.22-0.el8.noarch 28/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.0.4-10.el8.x86_64 29/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.1-9.el8.x86_64 30/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-8.el8.x86_64 31/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 32/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 33/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 34/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 35/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 36/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 37/140 2024-04-25T02:05:00.633 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 38/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 39/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 41/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 42/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 43/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 44/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 45/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 46/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 47/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 48/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 49/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 50/140 2024-04-25T02:05:00.634 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 51/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 53/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 54/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 55/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 56/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 57/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 58/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 59/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 60/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 61/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 62/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 63/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 64/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 65/140 2024-04-25T02:05:00.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 66/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 67/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 68/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 69/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 70/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 72/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 73/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : leveldb-1.22-1.el8.x86_64 74/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 75/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 76/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 77/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 79/140 2024-04-25T02:05:00.636 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 80/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 81/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 82/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 83/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 84/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 85/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 86/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 87/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 88/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 89/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-2.6-1.el8.noarch 90/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 91/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 92/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 93/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 94/140 2024-04-25T02:05:00.637 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 95/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 96/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 97/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 98/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 99/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 100/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 101/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 102/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 103/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 104/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 105/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 106/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 107/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 108/140 2024-04-25T02:05:00.638 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 109/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 110/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 111/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 112/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 113/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 114/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 115/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 117/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 119/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/140 2024-04-25T02:05:00.639 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 123/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 125/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 127/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 129/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 131/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 133/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 134/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 135/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 136/140 2024-04-25T02:05:00.640 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 137/140 2024-04-25T02:05:00.641 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 138/140 2024-04-25T02:05:00.641 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 139/140 2024-04-25T02:05:02.120 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 140/140 2024-04-25T02:05:02.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:02.120 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: iproute-6.2.0-5.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.121 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.0.4-10.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.122 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:14.2.22-0.el8.noarch 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.1-9.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-25T02:05:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-8.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: leveldb-1.22-1.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-25T02:05:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-25T02:05:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-25T02:05:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2024-04-25T02:05:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-25T02:05:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-25T02:05:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-25T02:05:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-25T02:05:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:02.130 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-04-25T02:05:02.434 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:02.480 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 140/140 2024-04-25T02:05:02.480 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:02.480 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: iproute-6.2.0-5.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.481 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.0.4-10.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.482 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:14.2.22-0.el8.noarch 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:14.2.22-0.el8.noarch 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:14.2.22-0.el8.noarch 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:14.2.22-0.el8.noarch 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.1-9.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-25T02:05:02.483 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-8.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: leveldb-1.22-1.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.484 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-25T02:05:02.485 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-25T02:05:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-2.6-1.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-25T02:05:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-25T02:05:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-25T02:05:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-25T02:05:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-25T02:05:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:02.490 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-25T02:05:02.710 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:02.710 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:05:02.710 INFO:teuthology.packaging:ref: None 2024-04-25T02:05:02.711 INFO:teuthology.packaging:tag: None 2024-04-25T02:05:02.711 INFO:teuthology.packaging:branch: nautilus 2024-04-25T02:05:02.711 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:05:02.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-25T02:05:02.962 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:05:02.987 INFO:teuthology.orchestra.run.smithi057.stdout:14.2.22-0.el8 2024-04-25T02:05:02.988 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2024-04-25T02:05:02.988 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2024-04-25T02:05:02.990 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:05:02.990 INFO:teuthology.packaging:ref: None 2024-04-25T02:05:02.990 INFO:teuthology.packaging:tag: None 2024-04-25T02:05:02.990 INFO:teuthology.packaging:branch: nautilus 2024-04-25T02:05:02.990 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:05:02.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2024-04-25T02:05:03.233 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:05:03.287 INFO:teuthology.orchestra.run.smithi088.stdout:14.2.22-0.el8 2024-04-25T02:05:03.287 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2024-04-25T02:05:03.287 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2024-04-25T02:05:03.289 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T02:05:03.290 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:03.290 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:05:03.323 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:05:03.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:05:03.397 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T02:05:03.398 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:03.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:05:03.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:05:03.495 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:05:03.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:05:03.564 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:05:03.676 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T02:05:03.676 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:03.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:05:03.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:05:03.773 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:05:03.773 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:05:03.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:05:03.947 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T02:05:03.947 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:03.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:05:03.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:05:04.044 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:05:04.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:05:04.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:05:04.219 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:05:04.228 INFO:teuthology.task.print:**** done installing nautilus 2024-04-25T02:05:04.228 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T02:05:04.304 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T02:05:04.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-04-25T02:05:04.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-04-25T02:05:04.373 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T02:05:04.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:05:04.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:05:04.443 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T02:05:04.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:05:04.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:05:04.524 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T02:05:04.524 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T02:05:04.524 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359', 'branch': 'squid', 'description': 'fs/upgrade/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672359', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCE+bBPmXXt7i0A5x++WS6uF/Ie30NLgpkX55ThwlsNo79s16FrB2M3frIWOg9MSU7I59dHziMtKUUabAiAbhzY=', 'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOKh9xOsjOZz3VucbaA5sI9lAGH706DaDG2fINOy3URJ6KVTm1JhpS60K4ALKCMGSBis1yE2NGuOdXBBLV3d+4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'nautilus', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'print': '**** done installing nautilus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'flavor': 'default', 'fs': 'xfs', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client nautilus']}}, {'print': '**** done ceph'}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_newops']}}], 'teuthology': {'branch': 'nautilus', 'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', "if not is_kupstream() or syntax_version() == 'v2' then reject() end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T02:05:04.525 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:05:04.527 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:05:04.571 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:05:04.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:05:04.679 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:04.680 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:05:04.698 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:05:04.698 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-04-25T02:05:04.756 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:05:04.756 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:05:04.756 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 174236 Links: 1 2024-04-25T02:05:04.756 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:05:04.757 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:05:04.757 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-25 02:05:00.290999895 +0000 2024-04-25T02:05:04.757 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 02:01:43.564954091 +0000 2024-04-25T02:05:04.757 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 02:01:43.564954091 +0000 2024-04-25T02:05:04.757 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T02:05:04.757 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:05:04.823 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-25T02:05:04.824 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-25T02:05:04.824 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.00028844 s, 1.8 MB/s 2024-04-25T02:05:04.825 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:05:04.884 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-04-25T02:05:04.942 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:05:04.943 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:05:04.943 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 173324 Links: 1 2024-04-25T02:05:04.943 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:05:04.943 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:05:04.943 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-25 02:05:00.290999895 +0000 2024-04-25T02:05:04.943 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 02:01:43.926948839 +0000 2024-04-25T02:05:04.943 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 02:01:43.926948839 +0000 2024-04-25T02:05:04.943 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T02:05:04.943 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:05:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-25T02:05:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-25T02:05:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000257592 s, 2.0 MB/s 2024-04-25T02:05:05.011 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:05:05.070 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-04-25T02:05:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:05:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:05:05.128 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 172259 Links: 1 2024-04-25T02:05:05.128 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:05:05.128 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:05:05.129 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-25 02:05:00.290999895 +0000 2024-04-25T02:05:05.129 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 02:01:44.263943949 +0000 2024-04-25T02:05:05.129 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 02:01:44.263943949 +0000 2024-04-25T02:05:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T02:05:05.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:05:05.195 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-25T02:05:05.196 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-25T02:05:05.196 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000341634 s, 1.5 MB/s 2024-04-25T02:05:05.196 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:05:05.256 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-04-25T02:05:05.315 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:05:05.315 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:05:05.315 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 169570 Links: 1 2024-04-25T02:05:05.315 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:05:05.315 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:05:05.315 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-25 02:05:00.290999895 +0000 2024-04-25T02:05:05.315 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 02:01:44.618938799 +0000 2024-04-25T02:05:05.316 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 02:01:44.618938799 +0000 2024-04-25T02:05:05.316 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T02:05:05.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:05:05.382 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-25T02:05:05.382 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-25T02:05:05.382 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.00033738 s, 1.5 MB/s 2024-04-25T02:05:05.383 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:05:05.443 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:05:05.443 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:05:05.443 INFO:tasks.ceph:Generating config... 2024-04-25T02:05:05.444 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-04-25T02:05:05.444 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-04-25T02:05:05.444 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-04-25T02:05:05.444 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T02:05:05.445 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T02:05:05.445 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T02:05:05.445 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T02:05:05.445 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T02:05:05.445 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T02:05:05.445 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T02:05:05.446 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T02:05:05.446 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T02:05:05.446 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T02:05:05.446 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T02:05:05.446 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T02:05:05.446 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T02:05:05.446 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T02:05:05.446 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T02:05:05.446 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T02:05:05.446 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T02:05:05.446 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T02:05:05.446 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T02:05:05.446 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T02:05:05.446 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T02:05:05.447 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T02:05:05.447 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T02:05:05.447 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T02:05:05.447 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T02:05:05.447 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T02:05:05.447 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T02:05:05.447 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T02:05:05.447 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T02:05:05.447 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T02:05:05.447 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T02:05:05.638 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T02:05:05.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T02:05:05.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:05:05.755 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '[v2:172.21.15.57:3301,v1:172.21.15.57:6790]'), ('mon.c', '[v2:172.21.15.57:3302,v1:172.21.15.57:6791]')] 2024-04-25T02:05:05.755 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T02:05:05.756 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:05.756 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:05:05.813 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --addv b '[v2:172.21.15.57:3301,v1:172.21.15.57:6790]' --addv c '[v2:172.21.15.57:3302,v1:172.21.15.57:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:05.884 INFO:teuthology.orchestra.run.smithi057.stderr:warning: line 130: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid f8b8656c-c3d2-4264-b256-59947e4191e7 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:fsid f8b8656c-c3d2-4264-b256-59947e4191e7 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2024-04-25 02:05:05.917413 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-04-25 02:05:05.917413 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 0 (unknown) 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] mon.b 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] mon.c 2024-04-25T02:05:05.922 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T02:05:05.924 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:05:05.982 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f8b8656c-c3d2-4264-b256-59947e4191e7... 2024-04-25T02:05:05.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:05:06.026 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-04-25T02:05:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-04-25T02:05:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on pool no app = False 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: ms bind msgr2 = False 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn min per osd = 0 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = f8b8656c-c3d2-4264-b256-59947e4191e7 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-04-25T02:05:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-04-25T02:05:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:05:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-04-25T02:05:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:05:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: mon down mkfs grace = 300 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-04-25T02:05:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2024-04-25T02:05:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T02:05:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2024-04-25T02:05:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2024-04-25T02:05:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2024-04-25T02:05:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2024-04-25T02:05:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-04-25T02:05:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-04-25T02:05:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-04-25T02:05:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-04-25T02:05:06.142 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-04-25T02:05:06.142 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:05:06.142 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-04-25T02:05:06.142 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.142 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-04-25T02:05:06.142 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:05:06.143 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.144 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on pool no app = False 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: ms bind msgr2 = False 2024-04-25T02:05:06.145 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn min per osd = 0 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on skipped message = False 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = f8b8656c-c3d2-4264-b256-59947e4191e7 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.146 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:05:06.147 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: bdev async discard = True 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: bdev enable discard = True 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore allocator = bitmap 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 1/20 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:05:06.148 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:05:06.150 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: mon down mkfs grace = 300 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-04-25T02:05:06.151 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-25T02:05:06.152 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2024-04-25T02:05:06.153 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2024-04-25T02:05:06.153 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2024-04-25T02:05:06.153 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2024-04-25T02:05:06.153 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-04-25T02:05:06.153 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-04-25T02:05:06.153 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-04-25T02:05:06.170 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T02:05:06.170 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T02:05:06.247 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T02:05:06.247 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:06.248 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T02:05:06.266 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:06.266 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T02:05:06.324 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:05:06.324 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:06.324 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:05:06.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:05:06.403 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:06.403 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:06.461 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-04-25T02:05:06.461 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:05:06.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:05:06.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:05:06.552 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:05:06.552 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:06.639 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T02:05:06.640 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T02:05:06.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:05:06.716 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:05:06.719 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T02:05:06.719 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:05:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:05:06.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T02:05:06.825 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T02:05:06.825 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T02:05:07.175 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T02:05:07.206 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T02:05:07.206 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:05:07.206 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T02:05:07.236 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:05:07.236 INFO:tasks.ceph:role: osd.0 2024-04-25T02:05:07.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:05:07.236 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T02:05:07.334 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:05:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:05:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:05:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:05:07.334 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:05:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:05:07.334 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:05:07.334 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:05:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:05:07.335 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:05:08.613 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-25T02:05:08.615 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-25T02:05:08.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T02:05:08.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T02:05:08.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T02:05:08.768 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:05:08.768 INFO:tasks.ceph:role: osd.1 2024-04-25T02:05:08.769 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:05:08.769 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T02:05:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:05:08.867 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:05:10.147 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-25T02:05:10.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-25T02:05:10.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T02:05:10.199 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T02:05:10.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T02:05:10.305 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:05:10.306 INFO:tasks.ceph:role: osd.2 2024-04-25T02:05:10.306 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:05:10.306 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T02:05:10.402 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:05:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:05:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:05:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:05:10.403 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:05:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:05:10.403 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:05:10.403 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:05:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:05:10.403 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:05:11.692 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-25T02:05:11.695 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-25T02:05:11.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T02:05:11.745 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T02:05:11.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T02:05:11.851 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:05:11.851 INFO:tasks.ceph:role: osd.3 2024-04-25T02:05:11.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:05:11.851 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:05:11.949 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:05:13.252 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-25T02:05:13.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-25T02:05:13.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T02:05:13.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T02:05:13.338 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:13.421 INFO:teuthology.orchestra.run.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:13.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:13.444 7f6031939dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T02:05:13.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:13.444 7f6031939dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T02:05:13.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:13.444 7f6031939dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:05:13.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:13.444 7f6031939dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:05:13.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:13.444 7f6031939dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:05:13.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:13.445 7f6031939dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T02:05:16.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:05:16.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:16.446 INFO:teuthology.orchestra.run.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:16.469 7feff5c9bdc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T02:05:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:16.470 7feff5c9bdc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T02:05:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:16.470 7feff5c9bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:05:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:16.470 7feff5c9bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:05:16.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:16.470 7feff5c9bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:05:16.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:16.470 7feff5c9bdc0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T02:05:19.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:05:19.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:19.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:19.450 7f0c6b656dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T02:05:19.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:19.450 7f0c6b656dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T02:05:19.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:19.450 7f0c6b656dc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:05:19.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:19.450 7f0c6b656dc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:05:19.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:19.450 7f0c6b656dc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:05:19.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:19.451 7f0c6b656dc0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T02:05:22.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:05:22.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:22.417 INFO:teuthology.orchestra.run.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:22.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:22.440 7f3b28524dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T02:05:22.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:22.440 7f3b28524dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T02:05:22.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:22.441 7f3b28524dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:05:22.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:22.441 7f3b28524dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:05:22.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:22.441 7f3b28524dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:05:22.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:22.441 7f3b28524dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T02:05:25.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:05:25.327 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T02:05:25.327 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:25.327 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T02:05:25.399 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:25.399 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T02:05:25.470 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:25.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T02:05:25.542 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:25.542 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T02:05:25.613 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:25.613 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T02:05:25.684 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:25.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T02:05:25.755 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:05:25.755 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T02:05:25.805 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T02:05:25.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T02:05:25.834 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2024-04-25T02:05:25.834 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBSuilmNntsKhAAELQvuVTpgBXHLgssPC1P/g== 2024-04-25T02:05:25.834 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-25T02:05:25.834 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBSuilmO1oWLxAArysde978mbarOwZSPMywzA== 2024-04-25T02:05:25.834 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2024-04-25T02:05:25.834 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBZuilmweqSGhAALXUj2D/6AlBLKdcUuXNzKA== 2024-04-25T02:05:25.834 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2024-04-25T02:05:25.835 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBcuilmbisWHBAAHiuivOC04I0il/7Hm9/uCQ== 2024-04-25T02:05:25.835 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2024-04-25T02:05:25.835 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBfuilmmFXvGhAAqldpMS3iYyQcUQ+W7AUYxQ== 2024-04-25T02:05:25.835 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2024-04-25T02:05:25.835 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBiuilmZV9aGhAAZYzZBXdw9fI3SY5KyjF5qQ== 2024-04-25T02:05:25.835 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-04-25T02:05:25.835 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBTuilmEbwpChAAcGmewNlQSRRToPdVh/V8cQ== 2024-04-25T02:05:25.836 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:05:25.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:05:26.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:05:26.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:05:26.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:05:26.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:05:26.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:05:26.406 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T02:05:26.406 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T02:05:26.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:05:26.515 INFO:teuthology.orchestra.run.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:26.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T02:05:26.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T02:05:26.703 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:05:26.784 INFO:teuthology.orchestra.run.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:26.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T02:05:26.899 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T02:05:26.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:05:27.049 INFO:teuthology.orchestra.run.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:27.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T02:05:27.170 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:05:27.228 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T02:05:27.229 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T02:05:27.229 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T02:05:27.270 INFO:tasks.ceph.mon.a:Started 2024-04-25T02:05:27.270 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T02:05:27.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T02:05:27.272 INFO:tasks.ceph.mon.b:Started 2024-04-25T02:05:27.272 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T02:05:27.272 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T02:05:27.274 INFO:tasks.ceph.mon.c:Started 2024-04-25T02:05:27.274 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T02:05:27.274 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T02:05:27.275 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T02:05:27.277 INFO:tasks.ceph.mgr.x:Started 2024-04-25T02:05:27.277 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T02:05:27.277 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T02:05:27.353 INFO:tasks.ceph.mon.a.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:27.356 INFO:tasks.ceph.mon.c.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:27.356 INFO:tasks.ceph.mgr.x.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:27.378 INFO:tasks.ceph.mon.b.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:27.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.432 7f03b2002700 1 Processor -- start 2024-04-25T02:05:27.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.432 7f03b2002700 1 -- start start 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03b2002700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 0x7f03ac10c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03b2002700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 0x7f03ac0f2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03b2002700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac0f26a0 con 0x7f03ac10c950 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03b2002700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0fa270 con 0x7f03ac0f5900 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03b2002700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0f95a0 con 0x7f03ac10cda0 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03aa5c5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f03ac10c950 0x7f03ac0f1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45766/0 (socket says 172.21.15.57:45766) 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03aa5c5700 1 -- 172.21.15.57:0/3684469709 learned_addr learned my addr 172.21.15.57:0/3684469709 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 0x7f03ac10c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03ab5c7700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 0x7f03ac0f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03aadc6700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 msgr2=0x7f03ac10c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:05:27.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03aadc6700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 msgr2=0x7f03ac10c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:05:27.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03ab5c7700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 msgr2=0x7f03ac0f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:05:27.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03ab5c7700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 msgr2=0x7f03ac0f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:05:27.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 0x7f03ac10c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:05:27.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03ab5c7700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 0x7f03ac0f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:05:27.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 0x7f03ac10c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:05:27.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.433 7f03ab5c7700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 0x7f03ac0f2070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:05:27.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 0x7f03ac10c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03ab5c7700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 0x7f03ac0f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03aadc6700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 msgr2=0x7f03ac10c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03aadc6700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 msgr2=0x7f03ac10c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03ab5c7700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 msgr2=0x7f03ac0f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03ab5c7700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 msgr2=0x7f03ac0f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 0x7f03ac10c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03ab5c7700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 0x7f03ac0f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03ab5c7700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 0x7f03ac0f2070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:05:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.634 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 0x7f03ac10c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:05:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.636 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149282075 0 0) 0x7f0394001110 con 0x7f03ac10c950 2024-04-25T02:05:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.636 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c003270 con 0x7f03ac10c950 2024-04-25T02:05:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 803549164 0 0) 0x7f03940015e0 con 0x7f03ac10c950 2024-04-25T02:05:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 msgr2=0x7f03ac0f2070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:05:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac10cda0 0x7f03ac0f2070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 msgr2=0x7f03ac10c320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac0f5900 0x7f03ac10c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac1aa5c0 con 0x7f03ac10c950 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 1795564270 0 0) 0x7f0394001b40 con 0x7f03ac10c950 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 >> v1:172.21.15.57:6789/0 conn(0x7f03ac10c950 legacy=0x7f03ac0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f038c003980 0x7f038c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f038c0045d0 0x7f038c004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f038c009810 0x7f038c00bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0fa270 con 0x7f038c0045d0 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0f95a0 con 0x7f038c009810 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f038c00c2a0 con 0x7f038c003980 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f038c003980 0x7f038c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03aa5c5700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f038c0045d0 0x7f038c004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03aadc6700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f038c009810 msgr2=0x7f038c00bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f038c009810 0x7f038c00bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03aadc6700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f038c0045d0 msgr2=0x7f038c004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f038c0045d0 0x7f038c004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03aadc6700 1 -- 172.21.15.57:0/3684469709 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac1aa5c0 con 0x7f038c003980 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.637 7f03aadc6700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f038c003980 0x7f038c003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f03a400a000 tx=0x7f03a400e230).ready entity=mon.2 client_cookie=2bae42e4cc9af3a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.638 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f03ac1aa5c0 con 0x7f038c003980 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.638 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a40106f0 con 0x7f038c003980 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.638 7f03a9dc4700 1 -- 172.21.15.57:0/3684469709 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f03a4010ac0 con 0x7f038c003980 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.638 7f03b2002700 1 -- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f038c003980 msgr2=0x7f038c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.638 7f03b2002700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f038c003980 0x7f038c003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f03a400a000 tx=0x7f03a400e230).stop 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.639 7f03b2002700 1 -- 172.21.15.57:0/3684469709 shutdown_connections 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.639 7f03b2002700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f038c009810 0x7f038c00bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.639 7f03b2002700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f038c003980 0x7f038c003dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.639 7f03b2002700 1 --2- 172.21.15.57:0/3684469709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f038c0045d0 0x7f038c004a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.639 7f03b2002700 1 -- 172.21.15.57:0/3684469709 >> 172.21.15.57:0/3684469709 conn(0x7f03ac113a50 msgr2=0x7f03ac0f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.639 7f03b2002700 1 -- 172.21.15.57:0/3684469709 shutdown_connections 2024-04-25T02:05:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.639 7f03b2002700 1 -- 172.21.15.57:0/3684469709 wait complete. 2024-04-25T02:05:27.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03b2002700 1 Processor -- start 2024-04-25T02:05:27.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03b2002700 1 -- start start 2024-04-25T02:05:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03b2002700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac1ad2f0 0x7f03ac1ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03b2002700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac1add70 0x7f03ac1b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03b2002700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1b4380 0x7f03ac1b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03b2002700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0a2690 con 0x7f03ac1b4380 2024-04-25T02:05:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03b2002700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0d70e0 con 0x7f03ac1add70 2024-04-25T02:05:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03b2002700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0c4110 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03aadc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac1ad2f0 0x7f03ac1ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03aadc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac1ad2f0 0x7f03ac1ad740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39280/0 (socket says 172.21.15.57:39280) 2024-04-25T02:05:27.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03aadc6700 1 -- 172.21.15.57:0/2738313901 learned_addr learned my addr 172.21.15.57:0/2738313901 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:27.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03aa5c5700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac1add70 0x7f03ac1b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.663 7f03ab5c7700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1b4380 0x7f03ac1b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03aadc6700 1 -- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac1add70 msgr2=0x7f03ac1b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03aadc6700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac1add70 0x7f03ac1b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03aadc6700 1 -- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1b4380 msgr2=0x7f03ac1b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03aadc6700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1b4380 0x7f03ac1b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03aadc6700 1 -- 172.21.15.57:0/2738313901 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0d6bb0 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03aadc6700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac1ad2f0 0x7f03ac1ad740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f03ac1a5a50 tx=0x7f03a400a040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03a3fff700 1 -- 172.21.15.57:0/2738313901 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f03ac0d6bb0 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03a3fff700 1 -- 172.21.15.57:0/2738313901 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a401dc20 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03b2002700 1 -- 172.21.15.57:0/2738313901 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac0ca9d0 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.664 7f03a3fff700 1 -- 172.21.15.57:0/2738313901 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f03a4014410 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.665 7f03b2002700 1 -- 172.21.15.57:0/2738313901 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac1bb4c0 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.665 7f03a3fff700 1 -- 172.21.15.57:0/2738313901 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f03a4014610 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.665 7f03a3fff700 1 -- 172.21.15.57:0/2738313901 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f03a4028400 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.665 7f03b2002700 1 -- 172.21.15.57:0/2738313901 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac0f08c0 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.668 7f03a3fff700 1 -- 172.21.15.57:0/2738313901 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f03a401d820 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.734 7f03b2002700 1 -- 172.21.15.57:0/2738313901 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f03ac0ab8c0 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.744 7f03a3fff700 1 -- 172.21.15.57:0/2738313901 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f038c003610 con 0x7f03ac1ad2f0 2024-04-25T02:05:27.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 -- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac1ad2f0 msgr2=0x7f03ac1ad740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:27.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac1ad2f0 0x7f03ac1ad740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f03ac1a5a50 tx=0x7f03a400a040).stop 2024-04-25T02:05:27.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 -- 172.21.15.57:0/2738313901 shutdown_connections 2024-04-25T02:05:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03ac1b4380 0x7f03ac1b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03ac1ad2f0 0x7f03ac1ad740 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 --2- 172.21.15.57:0/2738313901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03ac1add70 0x7f03ac1b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 -- 172.21.15.57:0/2738313901 >> 172.21.15.57:0/2738313901 conn(0x7f03ac1a4f20 msgr2=0x7f03ac0e0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 -- 172.21.15.57:0/2738313901 shutdown_connections 2024-04-25T02:05:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:27.745 7f03b2002700 1 -- 172.21.15.57:0/2738313901 wait complete. 2024-04-25T02:05:27.752 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2024-04-25T02:05:27.762 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T02:05:27.762 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T02:05:27.763 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:27.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T02:05:27.791 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:27.791 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T02:05:27.859 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:27.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T02:05:27.927 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T02:05:27.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T02:05:27.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new ddbfde7d-6964-42f8-931b-4c4181565274 0 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.159 7ff41d97f700 1 Processor -- start 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.159 7ff41d97f700 1 -- start start 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.159 7ff41d97f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4180f59f0 0x7ff41810b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff41d97f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff41810b720 0x7ff41819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff41d97f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff41810bb70 0x7ff4181a0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff41d97f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4180fa570 con 0x7ff4180f59f0 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff41d97f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4181a0880 con 0x7ff41810b720 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff41d97f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4181a0ab0 con 0x7ff41810bb70 2024-04-25T02:05:28.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff416dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff41810bb70 0x7ff4181a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff4165c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4180f59f0 0x7ff41810b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff415dc4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff41810b720 0x7ff41819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff4165c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff4180f59f0 0x7ff41810b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38804/0 (socket says 172.21.15.57:38804) 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff415dc4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff41810b720 0x7ff41819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:38658/0 (socket says 172.21.15.57:38658) 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff416dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff41810bb70 0x7ff4181a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39296/0 (socket says 172.21.15.57:39296) 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff4165c5700 1 -- 172.21.15.57:0/746293522 learned_addr learned my addr 172.21.15.57:0/746293522 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff415dc4700 1 -- 172.21.15.57:0/746293522 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff41810bb70 msgr2=0x7ff4181a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff415dc4700 1 --2- 172.21.15.57:0/746293522 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff41810bb70 0x7ff4181a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff415dc4700 1 -- 172.21.15.57:0/746293522 >> v2:172.21.15.57:3300/0 conn(0x7ff4180f59f0 msgr2=0x7ff41810b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff415dc4700 1 --2- 172.21.15.57:0/746293522 >> v2:172.21.15.57:3300/0 conn(0x7ff4180f59f0 0x7ff41810b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff415dc4700 1 -- 172.21.15.57:0/746293522 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4181a7390 con 0x7ff41810b720 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff4165c5700 1 --2- 172.21.15.57:0/746293522 >> v2:172.21.15.57:3300/0 conn(0x7ff4180f59f0 0x7ff41810b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff416dc6700 1 --2- 172.21.15.57:0/746293522 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff41810bb70 0x7ff4181a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:28.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff415dc4700 1 --2- 172.21.15.57:0/746293522 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff41810b720 0x7ff41819fc20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff4180f47a0 tx=0x7ff40000ba20).ready entity=mon.1 client_cookie=a8489b8f4c99de24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff4155c3700 1 -- 172.21.15.57:0/746293522 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4181a7390 con 0x7ff41810b720 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff4155c3700 1 -- 172.21.15.57:0/746293522 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000f970 con 0x7ff41810b720 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff4155c3700 1 -- 172.21.15.57:0/746293522 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff400015070 con 0x7ff41810b720 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff41d97f700 1 -- 172.21.15.57:0/746293522 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff41810b720 msgr2=0x7ff41819fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.160 7ff41d97f700 1 --2- 172.21.15.57:0/746293522 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff41810b720 0x7ff41819fc20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff4180f47a0 tx=0x7ff40000ba20).stop 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.161 7ff41d97f700 1 -- 172.21.15.57:0/746293522 shutdown_connections 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.161 7ff41d97f700 1 --2- 172.21.15.57:0/746293522 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff41810bb70 0x7ff4181a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.161 7ff41d97f700 1 --2- 172.21.15.57:0/746293522 >> v2:172.21.15.57:3300/0 conn(0x7ff4180f59f0 0x7ff41810b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.161 7ff41d97f700 1 --2- 172.21.15.57:0/746293522 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff41810b720 0x7ff41819fc20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.161 7ff41d97f700 1 -- 172.21.15.57:0/746293522 >> 172.21.15.57:0/746293522 conn(0x7ff418113a50 msgr2=0x7ff4180f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.161 7ff41d97f700 1 -- 172.21.15.57:0/746293522 shutdown_connections 2024-04-25T02:05:28.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.161 7ff41d97f700 1 -- 172.21.15.57:0/746293522 wait complete. 2024-04-25T02:05:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.185 7ff41d97f700 1 Processor -- start 2024-04-25T02:05:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff41d97f700 1 -- start start 2024-04-25T02:05:28.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff41d97f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4181a1800 0x7ff4180d5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff41d97f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4180d56c0 0x7ff4181afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff41d97f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4180d5b10 0x7ff4181b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff41d97f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180efde0 con 0x7ff4181a1800 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff41d97f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180d9a70 con 0x7ff4180d56c0 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff41d97f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4181a11a0 con 0x7ff4180d5b10 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff4165c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4181a1800 0x7ff4180d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff4165c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4181a1800 0x7ff4180d5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38814/0 (socket says 172.21.15.57:38814) 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff416dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4180d5b10 0x7ff4181b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff4165c5700 1 -- 172.21.15.57:0/3884360451 learned_addr learned my addr 172.21.15.57:0/3884360451 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.186 7ff415dc4700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4180d56c0 0x7ff4181afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff416dc6700 1 -- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4180d56c0 msgr2=0x7ff4181afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff416dc6700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4180d56c0 0x7ff4181afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff416dc6700 1 -- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4181a1800 msgr2=0x7ff4180d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff416dc6700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4181a1800 0x7ff4180d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff416dc6700 1 -- 172.21.15.57:0/3884360451 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4181b09e0 con 0x7ff4180d5b10 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff4165c5700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4181a1800 0x7ff4180d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:28.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff416dc6700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4180d5b10 0x7ff4181b03b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff4180c5ec0 tx=0x7ff41000e9f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff40f7fe700 1 -- 172.21.15.57:0/3884360451 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4181b09e0 con 0x7ff4180d5b10 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff40f7fe700 1 -- 172.21.15.57:0/3884360451 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410010780 con 0x7ff4180d5b10 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4181b7580 con 0x7ff4180d5b10 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff40f7fe700 1 -- 172.21.15.57:0/3884360451 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff41000f040 con 0x7ff4180d5b10 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4181b7960 con 0x7ff4180d5b10 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff40f7fe700 1 -- 172.21.15.57:0/3884360451 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff410011070 con 0x7ff4180d5b10 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.187 7ff40f7fe700 1 -- 172.21.15.57:0/3884360451 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff410010040 con 0x7ff4180d5b10 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.188 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4180f08c0 con 0x7ff4180d5b10 2024-04-25T02:05:28.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.190 7ff40f7fe700 1 -- 172.21.15.57:0/3884360451 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7ff410010380 con 0x7ff4180d5b10 2024-04-25T02:05:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.297 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd new", "uuid": "ddbfde7d-6964-42f8-931b-4c4181565274", "id": 0} v 0) v1 -- 0x7ff4181b0ca0 con 0x7ff4180d5b10 2024-04-25T02:05:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.307 7ff40f7fe700 1 -- 172.21.15.57:0/3884360451 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ddbfde7d-6964-42f8-931b-4c4181565274", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4181145d0 con 0x7ff4180d5b10 2024-04-25T02:05:28.313 INFO:teuthology.orchestra.run.smithi057.stdout:0 2024-04-25T02:05:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4180d5b10 msgr2=0x7ff4181b03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4180d5b10 0x7ff4181b03b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff4180c5ec0 tx=0x7ff41000e9f0).stop 2024-04-25T02:05:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 shutdown_connections 2024-04-25T02:05:28.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4180d5b10 0x7ff4181b03b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4181a1800 0x7ff4180d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 --2- 172.21.15.57:0/3884360451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4180d56c0 0x7ff4181afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 >> 172.21.15.57:0/3884360451 conn(0x7ff4180e1200 msgr2=0x7ff4180c2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 shutdown_connections 2024-04-25T02:05:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.309 7ff41d97f700 1 -- 172.21.15.57:0/3884360451 wait complete. 2024-04-25T02:05:28.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 76399db5-6fb7-4f04-9c9f-b35ff68a8d56 1 2024-04-25T02:05:28.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.450 7f760f77b700 1 Processor -- start 2024-04-25T02:05:28.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.450 7f760f77b700 1 -- start start 2024-04-25T02:05:28.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f760f77b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f760810b8f0 0x7f76081a5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f760f77b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081a59b0 0x7f76081a7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f760f77b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760810bd40 con 0x7f76080f59f0 2024-04-25T02:05:28.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f760f77b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080fa570 con 0x7f76081a59b0 2024-04-25T02:05:28.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f760f77b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76081a0c30 con 0x7f760810b8f0 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f7607fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f76080f59f0 0x7f760810b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45778/0 (socket says 172.21.15.57:45778) 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f7607fff700 1 -- 172.21.15.57:0/3023937941 learned_addr learned my addr 172.21.15.57:0/3023937941 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f760cd77700 1 --2- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081a59b0 0x7f76081a7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f76077fe700 1 --2- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f760810b8f0 0x7f76081a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f76077fe700 1 -- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081a59b0 msgr2=0x7f76081a7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f76077fe700 1 --2- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081a59b0 0x7f76081a7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f76077fe700 1 -- 172.21.15.57:0/3023937941 >> v1:172.21.15.57:6789/0 conn(0x7f76080f59f0 legacy=0x7f760810b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f76077fe700 1 -- 172.21.15.57:0/3023937941 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76081a9450 con 0x7f760810b8f0 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.451 7f760cd77700 1 --2- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081a59b0 0x7f76081a7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.452 7f76077fe700 1 --2- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f760810b8f0 0x7f76081a5380 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f76080f47a0 tx=0x7f75fc00b9d0).ready entity=mon.2 client_cookie=ddf5e1c97ba0d4e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.452 7f7606ffd700 1 -- 172.21.15.57:0/3023937941 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76081a9450 con 0x7f760810b8f0 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.452 7f7606ffd700 1 -- 172.21.15.57:0/3023937941 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00d570 con 0x7f760810b8f0 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.452 7f7606ffd700 1 -- 172.21.15.57:0/3023937941 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75fc00d940 con 0x7f760810b8f0 2024-04-25T02:05:28.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.452 7f760f77b700 1 -- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f760810b8f0 msgr2=0x7f76081a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.452 7f760f77b700 1 --2- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f760810b8f0 0x7f76081a5380 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f76080f47a0 tx=0x7f75fc00b9d0).stop 2024-04-25T02:05:28.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.453 7f760f77b700 1 -- 172.21.15.57:0/3023937941 shutdown_connections 2024-04-25T02:05:28.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.453 7f760f77b700 1 --2- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081a59b0 0x7f76081a7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.453 7f760f77b700 1 --2- 172.21.15.57:0/3023937941 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f760810b8f0 0x7f76081a5380 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.453 7f760f77b700 1 -- 172.21.15.57:0/3023937941 >> 172.21.15.57:0/3023937941 conn(0x7f7608113a50 msgr2=0x7f76080f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.453 7f760f77b700 1 -- 172.21.15.57:0/3023937941 shutdown_connections 2024-04-25T02:05:28.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.453 7f760f77b700 1 -- 172.21.15.57:0/3023937941 wait complete. 2024-04-25T02:05:28.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.487 7f760f77b700 1 Processor -- start 2024-04-25T02:05:28.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.487 7f760f77b700 1 -- start start 2024-04-25T02:05:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760f77b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76081a5590 0x7f76081ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760f77b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76081adcb0 0x7f76081b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760f77b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081ae100 0x7f76081b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760f77b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76080cfc20 con 0x7f76081a5590 2024-04-25T02:05:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760f77b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080c4240 con 0x7f76081ae100 2024-04-25T02:05:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760f77b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76081b4d50 con 0x7f76081adcb0 2024-04-25T02:05:28.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f7607fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76081a5590 0x7f76081ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760cd77700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081ae100 0x7f76081b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f7607fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76081a5590 0x7f76081ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38822/0 (socket says 172.21.15.57:38822) 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760cd77700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081ae100 0x7f76081b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:38698/0 (socket says 172.21.15.57:38698) 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f7607fff700 1 -- 172.21.15.57:0/4118558233 learned_addr learned my addr 172.21.15.57:0/4118558233 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f76077fe700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76081adcb0 0x7f76081b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760cd77700 1 -- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76081adcb0 msgr2=0x7f76081b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760cd77700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76081adcb0 0x7f76081b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760cd77700 1 -- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76081a5590 msgr2=0x7f76081ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760cd77700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76081a5590 0x7f76081ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f760cd77700 1 -- 172.21.15.57:0/4118558233 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76081b4f30 con 0x7f76081ae100 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f7607fff700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76081a5590 0x7f76081ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.488 7f76077fe700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76081adcb0 0x7f76081b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:28.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.489 7f760cd77700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081ae100 0x7f76081b4720 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f76080ca6c0 tx=0x7f760000ed70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.489 7f76057fa700 1 -- 172.21.15.57:0/4118558233 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76081b4f30 con 0x7f76081ae100 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.489 7f76057fa700 1 -- 172.21.15.57:0/4118558233 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000c880 con 0x7f76081ae100 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.489 7f760f77b700 1 -- 172.21.15.57:0/4118558233 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76081bb7e0 con 0x7f76081ae100 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.489 7f76057fa700 1 -- 172.21.15.57:0/4118558233 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f760000f040 con 0x7f76081ae100 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.489 7f760f77b700 1 -- 172.21.15.57:0/4118558233 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76081bbbc0 con 0x7f76081ae100 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.489 7f76057fa700 1 -- 172.21.15.57:0/4118558233 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7600022060 con 0x7f76081ae100 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.489 7f76057fa700 1 -- 172.21.15.57:0/4118558233 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 824+0+0 (secure 0 0 0) 0x7f7600010040 con 0x7f76081ae100 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.490 7f760f77b700 1 -- 172.21.15.57:0/4118558233 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76080f08c0 con 0x7f76081ae100 2024-04-25T02:05:28.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.492 7f76057fa700 1 -- 172.21.15.57:0/4118558233 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f760000c670 con 0x7f76081ae100 2024-04-25T02:05:28.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.565 7f760f77b700 1 -- 172.21.15.57:0/4118558233 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "76399db5-6fb7-4f04-9c9f-b35ff68a8d56", "id": 1} v 0) v1 -- 0x7f76081ae810 con 0x7f76081ae100 2024-04-25T02:05:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.574 7f76057fa700 1 -- 172.21.15.57:0/4118558233 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76399db5-6fb7-4f04-9c9f-b35ff68a8d56", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f76081145d0 con 0x7f76081ae100 2024-04-25T02:05:28.581 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 -- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081ae100 msgr2=0x7f76081b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081ae100 0x7f76081b4720 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f76080ca6c0 tx=0x7f760000ed70).stop 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 -- 172.21.15.57:0/4118558233 shutdown_connections 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76081ae100 0x7f76081b4720 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76081a5590 0x7f76081ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 --2- 172.21.15.57:0/4118558233 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76081adcb0 0x7f76081b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 -- 172.21.15.57:0/4118558233 >> 172.21.15.57:0/4118558233 conn(0x7f76080e02f0 msgr2=0x7f76080c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 -- 172.21.15.57:0/4118558233 shutdown_connections 2024-04-25T02:05:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.575 7f760f77b700 1 -- 172.21.15.57:0/4118558233 wait complete. 2024-04-25T02:05:28.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new f0f51faf-c079-4f62-80db-dbec64d28887 2 2024-04-25T02:05:28.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.718 7f726bb5a700 1 Processor -- start 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.718 7f726bb5a700 1 -- start start 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f726bb5a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72640f5900 0x7f72640f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f726bb5a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640f22f0 0x7f726410ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f726bb5a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72640f9210 con 0x7f72640f1ea0 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f726bb5a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726410f0c0 con 0x7f72640f5900 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f726bb5a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72641ac660 con 0x7f72640f22f0 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7268955700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72640f5900 0x7f72640f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7268955700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72640f5900 0x7f72640f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38828/0 (socket says 172.21.15.57:38828) 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7268955700 1 -- 172.21.15.57:0/1609112706 learned_addr learned my addr 172.21.15.57:0/1609112706 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7263fff700 1 --1- 172.21.15.57:0/1609112706 >> v1:172.21.15.57:6789/0 conn(0x7f72640f1ea0 0x7f726410e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45780/0 (socket says 172.21.15.57:45780) 2024-04-25T02:05:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7269156700 1 --2- 172.21.15.57:0/1609112706 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640f22f0 0x7f726410ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7268955700 1 -- 172.21.15.57:0/1609112706 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640f22f0 msgr2=0x7f726410ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7268955700 1 --2- 172.21.15.57:0/1609112706 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640f22f0 0x7f726410ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7268955700 1 -- 172.21.15.57:0/1609112706 >> v1:172.21.15.57:6789/0 conn(0x7f72640f1ea0 legacy=0x7f726410e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f72637fe700 1 -- 172.21.15.57:0/1609112706 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192230867 0 0) 0x7f7258001110 con 0x7f72640f1ea0 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7268955700 1 -- 172.21.15.57:0/1609112706 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72641ac810 con 0x7f72640f5900 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.719 7f7268955700 1 --2- 172.21.15.57:0/1609112706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72640f5900 0x7f72640f1870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f72641037d0 tx=0x7f7254009a80).ready entity=mon.0 client_cookie=e0470c2bafc77f43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f72637fe700 1 -- 172.21.15.57:0/1609112706 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72641ac810 con 0x7f72640f5900 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f72637fe700 1 -- 172.21.15.57:0/1609112706 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725400f510 con 0x7f72640f5900 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f72637fe700 1 -- 172.21.15.57:0/1609112706 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f725400f6f0 con 0x7f72640f5900 2024-04-25T02:05:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f726bb5a700 1 -- 172.21.15.57:0/1609112706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72640f5900 msgr2=0x7f72640f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f726bb5a700 1 --2- 172.21.15.57:0/1609112706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72640f5900 0x7f72640f1870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f72641037d0 tx=0x7f7254009a80).stop 2024-04-25T02:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f726bb5a700 1 -- 172.21.15.57:0/1609112706 shutdown_connections 2024-04-25T02:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f726bb5a700 1 --2- 172.21.15.57:0/1609112706 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640f22f0 0x7f726410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f726bb5a700 1 --2- 172.21.15.57:0/1609112706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72640f5900 0x7f72640f1870 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f726bb5a700 1 -- 172.21.15.57:0/1609112706 >> 172.21.15.57:0/1609112706 conn(0x7f7264113a50 msgr2=0x7f72640f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f726bb5a700 1 -- 172.21.15.57:0/1609112706 shutdown_connections 2024-04-25T02:05:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.720 7f726bb5a700 1 -- 172.21.15.57:0/1609112706 wait complete. 2024-04-25T02:05:28.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.744 7f726bb5a700 1 Processor -- start 2024-04-25T02:05:28.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.744 7f726bb5a700 1 -- start start 2024-04-25T02:05:28.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f726bb5a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640d1790 0x7f72640d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f726bb5a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f72640d2210 0x7f72641b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f726bb5a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72641b45d0 0x7f72641b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f726bb5a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72640e6610 con 0x7f72641b45d0 2024-04-25T02:05:28.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f726bb5a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72640d3b60 con 0x7f72640d2210 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f726bb5a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72641b5050 con 0x7f72640d1790 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f7268955700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640d1790 0x7f72640d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f7269156700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72641b45d0 0x7f72641b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f7268955700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640d1790 0x7f72640d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39350/0 (socket says 172.21.15.57:39350) 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f7268955700 1 -- 172.21.15.57:0/1857152184 learned_addr learned my addr 172.21.15.57:0/1857152184 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f7269156700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72641b45d0 0x7f72641b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38844/0 (socket says 172.21.15.57:38844) 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.745 7f7263fff700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f72640d2210 0x7f72641b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7269156700 1 -- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640d1790 msgr2=0x7f72640d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7269156700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640d1790 0x7f72640d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7269156700 1 -- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f72640d2210 msgr2=0x7f72641b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7269156700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f72640d2210 0x7f72641b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7269156700 1 -- 172.21.15.57:0/1857152184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72640e0820 con 0x7f72641b45d0 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7268955700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640d1790 0x7f72640d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7263fff700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f72640d2210 0x7f72641b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7269156700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72641b45d0 0x7f72641b4a20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f72640d4290 tx=0x7f725c00ed40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7261ffb700 1 -- 172.21.15.57:0/1857152184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f72640e0820 con 0x7f72641b45d0 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7261ffb700 1 -- 172.21.15.57:0/1857152184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c00c880 con 0x7f72641b45d0 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72640d3e20 con 0x7f72641b45d0 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7261ffb700 1 -- 172.21.15.57:0/1857152184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f725c00f040 con 0x7f72641b45d0 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72640c5040 con 0x7f72641b45d0 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7261ffb700 1 -- 172.21.15.57:0/1857152184 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f725c022060 con 0x7f72641b45d0 2024-04-25T02:05:28.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.746 7f7261ffb700 1 -- 172.21.15.57:0/1857152184 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 927+0+0 (secure 0 0 0) 0x7f725c010040 con 0x7f72641b45d0 2024-04-25T02:05:28.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.747 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72640f08c0 con 0x7f72641b45d0 2024-04-25T02:05:28.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.749 7f7261ffb700 1 -- 172.21.15.57:0/1857152184 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f725c00c670 con 0x7f72641b45d0 2024-04-25T02:05:28.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.823 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f0f51faf-c079-4f62-80db-dbec64d28887", "id": 2} v 0) v1 -- 0x7f72640eff90 con 0x7f72641b45d0 2024-04-25T02:05:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.830 7f7261ffb700 1 -- 172.21.15.57:0/1857152184 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0f51faf-c079-4f62-80db-dbec64d28887", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72641145d0 con 0x7f72641b45d0 2024-04-25T02:05:28.836 INFO:teuthology.orchestra.run.smithi057.stdout:2 2024-04-25T02:05:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72641b45d0 msgr2=0x7f72641b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72641b45d0 0x7f72641b4a20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f72640d4290 tx=0x7f725c00ed40).stop 2024-04-25T02:05:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 shutdown_connections 2024-04-25T02:05:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72641b45d0 0x7f72641b4a20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f72640d1790 0x7f72640d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 --2- 172.21.15.57:0/1857152184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f72640d2210 0x7f72641b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 >> 172.21.15.57:0/1857152184 conn(0x7f72640e11f0 msgr2=0x7f72640d83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 shutdown_connections 2024-04-25T02:05:28.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.831 7f726bb5a700 1 -- 172.21.15.57:0/1857152184 wait complete. 2024-04-25T02:05:28.849 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 56f7d9c7-7455-4936-91f1-96bbc0ff7d78 3 2024-04-25T02:05:28.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.973 7fba5c1f9700 1 Processor -- start 2024-04-25T02:05:28.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.973 7fba5c1f9700 1 -- start start 2024-04-25T02:05:28.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.973 7fba5c1f9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba541064a0 0x7fba5410e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.973 7fba5c1f9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fba5410ea00 0x7fba540f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:28.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.973 7fba5c1f9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba540f1da0 con 0x7fba5410ee50 2024-04-25T02:05:28.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.973 7fba5c1f9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba540fb5e0 con 0x7fba5410ea00 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.973 7fba5c1f9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba541068f0 con 0x7fba541064a0 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba58ff4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba541064a0 0x7fba5410e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba53fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fba5410ea00 0x7fba540f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba53fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fba5410ea00 0x7fba540f0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38846/0 (socket says 172.21.15.57:38846) 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba58ff4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba541064a0 0x7fba5410e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:38716/0 (socket says 172.21.15.57:38716) 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba53fff700 1 -- 172.21.15.57:0/492713467 learned_addr learned my addr 172.21.15.57:0/492713467 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba53fff700 1 -- 172.21.15.57:0/492713467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba541064a0 msgr2=0x7fba5410e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba53fff700 1 --2- 172.21.15.57:0/492713467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba541064a0 0x7fba5410e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba53fff700 1 -- 172.21.15.57:0/492713467 >> v1:172.21.15.57:6789/0 conn(0x7fba5410ee50 legacy=0x7fba540f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba53fff700 1 -- 172.21.15.57:0/492713467 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba541ac730 con 0x7fba5410ea00 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba537fe700 1 -- 172.21.15.57:0/492713467 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826459326 0 0) 0x7fba4c001490 con 0x7fba5410ee50 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba53fff700 1 --2- 172.21.15.57:0/492713467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba5410ea00 0x7fba540f0f70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fba540fb790 tx=0x7fba40009a80).ready entity=mon.0 client_cookie=d1f4e5fe027edd46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba537fe700 1 -- 172.21.15.57:0/492713467 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba541ac730 con 0x7fba5410ea00 2024-04-25T02:05:28.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba537fe700 1 -- 172.21.15.57:0/492713467 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4000f510 con 0x7fba5410ea00 2024-04-25T02:05:28.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba537fe700 1 -- 172.21.15.57:0/492713467 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba4000f740 con 0x7fba5410ea00 2024-04-25T02:05:28.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba5c1f9700 1 -- 172.21.15.57:0/492713467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba5410ea00 msgr2=0x7fba540f0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:28.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.974 7fba5c1f9700 1 --2- 172.21.15.57:0/492713467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba5410ea00 0x7fba540f0f70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fba540fb790 tx=0x7fba40009a80).stop 2024-04-25T02:05:28.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.975 7fba5c1f9700 1 -- 172.21.15.57:0/492713467 shutdown_connections 2024-04-25T02:05:28.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.975 7fba5c1f9700 1 --2- 172.21.15.57:0/492713467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba541064a0 0x7fba5410e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.975 7fba5c1f9700 1 --2- 172.21.15.57:0/492713467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba5410ea00 0x7fba540f0f70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:28.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.975 7fba5c1f9700 1 -- 172.21.15.57:0/492713467 >> 172.21.15.57:0/492713467 conn(0x7fba541148b0 msgr2=0x7fba54114d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:28.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.975 7fba5c1f9700 1 -- 172.21.15.57:0/492713467 shutdown_connections 2024-04-25T02:05:28.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:28.975 7fba5c1f9700 1 -- 172.21.15.57:0/492713467 wait complete. 2024-04-25T02:05:29.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.000 7fba5c1f9700 1 Processor -- start 2024-04-25T02:05:29.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.000 7fba5c1f9700 1 -- start start 2024-04-25T02:05:29.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.000 7fba5c1f9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fba540c8ad0 0x7fba540d5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.000 7fba5c1f9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba540d58b0 0x7fba541b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.000 7fba5c1f9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba540d5d00 0x7fba541b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.000 7fba5c1f9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba540da450 con 0x7fba540d5d00 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.000 7fba5c1f9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba541b4e90 con 0x7fba540d58b0 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.000 7fba5c1f9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba541b50c0 con 0x7fba540c8ad0 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba58ff4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fba540c8ad0 0x7fba540d5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba597f5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba540d5d00 0x7fba541b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba53fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba540d58b0 0x7fba541b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba58ff4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fba540c8ad0 0x7fba540d5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39364/0 (socket says 172.21.15.57:39364) 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba58ff4700 1 -- 172.21.15.57:0/3014835891 learned_addr learned my addr 172.21.15.57:0/3014835891 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba53fff700 1 -- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fba540c8ad0 msgr2=0x7fba540d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba53fff700 1 --2- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fba540c8ad0 0x7fba540d5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba53fff700 1 -- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba540d5d00 msgr2=0x7fba541b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba53fff700 1 --2- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba540d5d00 0x7fba541b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba53fff700 1 -- 172.21.15.57:0/3014835891 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba541bb9b0 con 0x7fba540d58b0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba597f5700 1 --2- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba540d5d00 0x7fba541b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba53fff700 1 --2- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba540d58b0 0x7fba541b4230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fba540fb790 tx=0x7fba400068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba51ffb700 1 -- 172.21.15.57:0/3014835891 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba541bb9b0 con 0x7fba540d58b0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba51ffb700 1 -- 172.21.15.57:0/3014835891 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba400116d0 con 0x7fba540d58b0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba541bbbb0 con 0x7fba540d58b0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba51ffb700 1 -- 172.21.15.57:0/3014835891 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba40021070 con 0x7fba540d58b0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.001 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba541bbdb0 con 0x7fba540d58b0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.002 7fba51ffb700 1 -- 172.21.15.57:0/3014835891 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7fba40019030 con 0x7fba540d58b0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.002 7fba51ffb700 1 -- 172.21.15.57:0/3014835891 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1030+0+0 (secure 0 0 0) 0x7fba40018040 con 0x7fba540d58b0 2024-04-25T02:05:29.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.002 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba540f0850 con 0x7fba540d58b0 2024-04-25T02:05:29.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.004 7fba51ffb700 1 -- 172.21.15.57:0/3014835891 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7fba400114c0 con 0x7fba540d58b0 2024-04-25T02:05:29.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.078 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "56f7d9c7-7455-4936-91f1-96bbc0ff7d78", "id": 3} v 0) v1 -- 0x7fba541ae9b0 con 0x7fba540d58b0 2024-04-25T02:05:29.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.086 7fba51ffb700 1 -- 172.21.15.57:0/3014835891 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56f7d9c7-7455-4936-91f1-96bbc0ff7d78", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba4000f300 con 0x7fba540d58b0 2024-04-25T02:05:29.092 INFO:teuthology.orchestra.run.smithi057.stdout:3 2024-04-25T02:05:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba540d58b0 msgr2=0x7fba541b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 --2- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba540d58b0 0x7fba541b4230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fba540fb790 tx=0x7fba400068c0).stop 2024-04-25T02:05:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 shutdown_connections 2024-04-25T02:05:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 --2- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba540d5d00 0x7fba541b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 --2- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fba540c8ad0 0x7fba540d5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 --2- 172.21.15.57:0/3014835891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba540d58b0 0x7fba541b4230 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 >> 172.21.15.57:0/3014835891 conn(0x7fba540c6bc0 msgr2=0x7fba540d62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 shutdown_connections 2024-04-25T02:05:29.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.087 7fba5c1f9700 1 -- 172.21.15.57:0/3014835891 wait complete. 2024-04-25T02:05:29.104 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T02:05:29.104 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T02:05:29.106 INFO:tasks.ceph.osd.0:Started 2024-04-25T02:05:29.106 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T02:05:29.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T02:05:29.108 INFO:tasks.ceph.osd.1:Started 2024-04-25T02:05:29.108 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T02:05:29.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T02:05:29.110 INFO:tasks.ceph.osd.2:Started 2024-04-25T02:05:29.111 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T02:05:29.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T02:05:29.113 INFO:tasks.ceph.osd.3:Started 2024-04-25T02:05:29.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:29.192 INFO:tasks.ceph.osd.1.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:29.214 INFO:tasks.ceph.osd.0.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:29.218 INFO:tasks.ceph.osd.2.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:29.222 INFO:tasks.ceph.osd.3.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:29.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.299 7f1cf9bcb700 1 Processor -- start 2024-04-25T02:05:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.299 7f1cf9bcb700 1 -- start start 2024-04-25T02:05:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf9bcb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1cf41aabb0 0x7f1cf41ad010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf9bcb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf41ad640 0x7f1cf41afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf9bcb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf40f7de0 con 0x7f1cf41a0b80 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf285d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1cf41a0b80 0x7f1cf41a0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45856/0 (socket says 172.21.15.57:45856) 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf285d700 1 -- 172.21.15.57:0/1966456568 learned_addr learned my addr 172.21.15.57:0/1966456568 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf205c700 1 --2- 172.21.15.57:0/1966456568 >> v2:172.21.15.57:3300/0 conn(0x7f1cf41aabb0 0x7f1cf41ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf9bcb700 1 -- 172.21.15.57:0/1966456568 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf40f7130 con 0x7f1cf41aabb0 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf9bcb700 1 -- 172.21.15.57:0/1966456568 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40f83a0 con 0x7f1cf41ad640 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf305e700 1 --2- 172.21.15.57:0/1966456568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf41ad640 0x7f1cf41afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf185b700 1 -- 172.21.15.57:0/1966456568 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147286300 0 0) 0x7f1ce4001110 con 0x7f1cf41a0b80 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf185b700 1 -- 172.21.15.57:0/1966456568 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd8003270 con 0x7f1cf41a0b80 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf205c700 1 -- 172.21.15.57:0/1966456568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf41ad640 msgr2=0x7f1cf41afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:29.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf205c700 1 --2- 172.21.15.57:0/1966456568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf41ad640 0x7f1cf41afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf205c700 1 -- 172.21.15.57:0/1966456568 >> v1:172.21.15.57:6789/0 conn(0x7f1cf41a0b80 legacy=0x7f1cf41a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.300 7f1cf205c700 1 -- 172.21.15.57:0/1966456568 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf41a17d0 con 0x7f1cf41aabb0 2024-04-25T02:05:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.301 7f1cf205c700 1 --2- 172.21.15.57:0/1966456568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf41aabb0 0x7f1cf41ad010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f1cf4087420 tx=0x7f1ce800ba20).ready entity=mon.0 client_cookie=fc90ee24abc59ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.301 7f1cf185b700 1 -- 172.21.15.57:0/1966456568 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1cf41a17d0 con 0x7f1cf41aabb0 2024-04-25T02:05:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.301 7f1cf185b700 1 -- 172.21.15.57:0/1966456568 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce800d5c0 con 0x7f1cf41aabb0 2024-04-25T02:05:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.301 7f1cf185b700 1 -- 172.21.15.57:0/1966456568 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ce800d990 con 0x7f1cf41aabb0 2024-04-25T02:05:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.301 7f1cf9bcb700 1 -- 172.21.15.57:0/1966456568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf41aabb0 msgr2=0x7f1cf41ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.301 7f1cf9bcb700 1 --2- 172.21.15.57:0/1966456568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf41aabb0 0x7f1cf41ad010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f1cf4087420 tx=0x7f1ce800ba20).stop 2024-04-25T02:05:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.302 7f1cf9bcb700 1 -- 172.21.15.57:0/1966456568 shutdown_connections 2024-04-25T02:05:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.302 7f1cf9bcb700 1 --2- 172.21.15.57:0/1966456568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf41ad640 0x7f1cf41afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.302 7f1cf9bcb700 1 --2- 172.21.15.57:0/1966456568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf41aabb0 0x7f1cf41ad010 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.302 7f1cf9bcb700 1 -- 172.21.15.57:0/1966456568 >> 172.21.15.57:0/1966456568 conn(0x7f1cf4114940 msgr2=0x7f1cf4114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.302 7f1cf9bcb700 1 -- 172.21.15.57:0/1966456568 shutdown_connections 2024-04-25T02:05:29.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.302 7f1cf9bcb700 1 -- 172.21.15.57:0/1966456568 wait complete. 2024-04-25T02:05:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.326 7f1cf9bcb700 1 Processor -- start 2024-04-25T02:05:29.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.326 7f1cf9bcb700 1 -- start start 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.326 7f1cf9bcb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf40d5330 0x7f1cf40d5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.326 7f1cf9bcb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf40d5db0 0x7f1cf41b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.326 7f1cf9bcb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cf41b8e10 0x7f1cf41b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.326 7f1cf9bcb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf41b9890 con 0x7f1cf40d5db0 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.326 7f1cf9bcb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40cc140 con 0x7f1cf41b8e10 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.326 7f1cf9bcb700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40da850 con 0x7f1cf40d5330 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cf41b8e10 0x7f1cf41b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf285d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf40d5330 0x7f1cf40d5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cf41b8e10 0x7f1cf41b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:38780/0 (socket says 172.21.15.57:38780) 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 -- 172.21.15.57:0/1063014781 learned_addr learned my addr 172.21.15.57:0/1063014781 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf205c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf40d5db0 0x7f1cf41b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 -- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf40d5330 msgr2=0x7f1cf40d5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 --2- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf40d5330 0x7f1cf40d5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 -- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf40d5db0 msgr2=0x7f1cf41b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 --2- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf40d5db0 0x7f1cf41b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 -- 172.21.15.57:0/1063014781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf41bff50 con 0x7f1cf41b8e10 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf285d700 1 --2- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf40d5330 0x7f1cf40d5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf305e700 1 --2- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cf41b8e10 0x7f1cf41b9260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1cf40c2650 tx=0x7f1cec00ee20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1ce3fff700 1 -- 172.21.15.57:0/1063014781 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1cf41bff50 con 0x7f1cf41b8e10 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1ce3fff700 1 -- 172.21.15.57:0/1063014781 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00c880 con 0x7f1cf41b8e10 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf41c0150 con 0x7f1cf41b8e10 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.327 7f1ce3fff700 1 -- 172.21.15.57:0/1063014781 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1cec00f040 con 0x7f1cf41b8e10 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.328 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf41c0530 con 0x7f1cf41b8e10 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.328 7f1ce3fff700 1 -- 172.21.15.57:0/1063014781 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1cec019070 con 0x7f1cf41b8e10 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.328 7f1ce3fff700 1 -- 172.21.15.57:0/1063014781 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1133+0+0 (secure 0 0 0) 0x7f1cec010040 con 0x7f1cf41b8e10 2024-04-25T02:05:29.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.328 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf40f08e0 con 0x7f1cf41b8e10 2024-04-25T02:05:29.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.330 7f1ce3fff700 1 -- 172.21.15.57:0/1063014781 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f1cec00c670 con 0x7f1cf41b8e10 2024-04-25T02:05:29.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.391 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cf41b2ee0 con 0x7f1cf41b8e10 2024-04-25T02:05:29.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.391 7f1ce3fff700 1 -- 172.21.15.57:0/1063014781 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3216 (secure 0 0 0) 0x7f1cf4115700 con 0x7f1cf41b8e10 2024-04-25T02:05:29.398 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:29.398 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":6,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:29.080329","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:29.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cf41b8e10 msgr2=0x7f1cf41b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 --2- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cf41b8e10 0x7f1cf41b9260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1cf40c2650 tx=0x7f1cec00ee20).stop 2024-04-25T02:05:29.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 shutdown_connections 2024-04-25T02:05:29.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 --2- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cf41b8e10 0x7f1cf41b9260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 --2- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cf40d5330 0x7f1cf40d5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 --2- 172.21.15.57:0/1063014781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cf40d5db0 0x7f1cf41b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 >> 172.21.15.57:0/1063014781 conn(0x7f1cf40c6c70 msgr2=0x7f1cf40d6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 shutdown_connections 2024-04-25T02:05:29.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:29.392 7f1cf9bcb700 1 -- 172.21.15.57:0/1063014781 wait complete. 2024-04-25T02:05:29.410 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T02:05:29.410 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T02:05:29.797 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-04-25 02:05:29.790 7f54be596dc0 -1 Falling back to public interface 2024-04-25T02:05:29.801 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-04-25 02:05:29.795 7f3456509dc0 -1 Falling back to public interface 2024-04-25T02:05:29.813 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:29.813 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-04-25 02:05:29.806 7f8801479dc0 -1 Falling back to public interface 2024-04-25T02:05:29.818 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25 02:05:29.811 7f39826f2dc0 -1 Falling back to public interface 2024-04-25T02:05:29.940 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.932 7ff21eb90700 1 Processor -- start 2024-04-25T02:05:29.940 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.932 7ff21eb90700 1 -- start start 2024-04-25T02:05:29.940 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.932 7ff21eb90700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2180f58a0 0x7ff2180f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.940 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.932 7ff21eb90700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2180f2290 0x7ff21810ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.940 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff21eb90700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2180f91b0 con 0x7ff2180f1e40 2024-04-25T02:05:29.940 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff21eb90700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21810f060 con 0x7ff2180f58a0 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff21eb90700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2181ac600 con 0x7ff2180f2290 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff2177fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2180f58a0 0x7ff2180f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff217fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2180f2290 0x7ff21810ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff2177fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2180f58a0 0x7ff2180f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38892/0 (socket says 172.21.15.57:38892) 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff216ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff2180f1e40 0x7ff21810e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45868/0 (socket says 172.21.15.57:45868) 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff2177fe700 1 -- 172.21.15.57:0/2061846774 learned_addr learned my addr 172.21.15.57:0/2061846774 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff217fff700 1 -- 172.21.15.57:0/2061846774 >> v2:172.21.15.57:3300/0 conn(0x7ff2180f58a0 msgr2=0x7ff2180f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff217fff700 1 --2- 172.21.15.57:0/2061846774 >> v2:172.21.15.57:3300/0 conn(0x7ff2180f58a0 0x7ff2180f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff217fff700 1 -- 172.21.15.57:0/2061846774 >> v1:172.21.15.57:6789/0 conn(0x7ff2180f1e40 legacy=0x7ff21810e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff217fff700 1 -- 172.21.15.57:0/2061846774 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2181ac7b0 con 0x7ff2180f2290 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff217fff700 1 --2- 172.21.15.57:0/2061846774 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2180f2290 0x7ff21810ea30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff20c001380 tx=0x7ff20c001080).ready entity=mon.2 client_cookie=6ef58cc53a053a01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff2167fc700 1 -- 172.21.15.57:0/2061846774 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff2181ac7b0 con 0x7ff2180f2290 2024-04-25T02:05:29.941 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff2167fc700 1 -- 172.21.15.57:0/2061846774 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21000b740 con 0x7ff2180f2290 2024-04-25T02:05:29.942 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff21eb90700 1 -- 172.21.15.57:0/2061846774 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2180f2290 msgr2=0x7ff21810ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.942 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff2167fc700 1 -- 172.21.15.57:0/2061846774 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff21000b920 con 0x7ff2180f2290 2024-04-25T02:05:29.942 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.933 7ff21eb90700 1 --2- 172.21.15.57:0/2061846774 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2180f2290 0x7ff21810ea30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff20c001380 tx=0x7ff20c001080).stop 2024-04-25T02:05:29.942 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.934 7ff21eb90700 1 -- 172.21.15.57:0/2061846774 shutdown_connections 2024-04-25T02:05:29.943 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.934 7ff21eb90700 1 --2- 172.21.15.57:0/2061846774 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2180f2290 0x7ff21810ea30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.943 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.934 7ff21eb90700 1 --2- 172.21.15.57:0/2061846774 >> v2:172.21.15.57:3300/0 conn(0x7ff2180f58a0 0x7ff2180f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.943 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.934 7ff21eb90700 1 -- 172.21.15.57:0/2061846774 >> 172.21.15.57:0/2061846774 conn(0x7ff2181139f0 msgr2=0x7ff2180f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:29.943 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.934 7ff21eb90700 1 -- 172.21.15.57:0/2061846774 shutdown_connections 2024-04-25T02:05:29.943 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.934 7ff21eb90700 1 -- 172.21.15.57:0/2061846774 wait complete. 2024-04-25T02:05:29.965 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.958 7ff21eb90700 1 Processor -- start 2024-04-25T02:05:29.965 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff21eb90700 1 -- start start 2024-04-25T02:05:29.967 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff21eb90700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2180cb8d0 0x7ff2180cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff21eb90700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2181b4300 0x7ff2181b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff21eb90700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff2181b4d80 0x7ff2181bb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff21eb90700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180bc490 con 0x7ff2180cb8d0 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff21eb90700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180d5bb0 con 0x7ff2181b4d80 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff21eb90700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180d1e90 con 0x7ff2181b4300 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff2177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2180cb8d0 0x7ff2180cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff2177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2180cb8d0 0x7ff2180cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38902/0 (socket says 172.21.15.57:38902) 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff2177fe700 1 -- 172.21.15.57:0/1017583444 learned_addr learned my addr 172.21.15.57:0/1017583444 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff216ffd700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2181b4300 0x7ff2181b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.959 7ff217fff700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff2181b4d80 0x7ff2181bb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff2177fe700 1 -- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2181b4300 msgr2=0x7ff2181b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff2177fe700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2181b4300 0x7ff2181b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.968 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff2177fe700 1 -- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff2181b4d80 msgr2=0x7ff2181bb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff2177fe700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff2181b4d80 0x7ff2181bb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff2177fe700 1 -- 172.21.15.57:0/1017583444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180d2570 con 0x7ff2180cb8d0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff216ffd700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2181b4300 0x7ff2181b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff217fff700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff2181b4d80 0x7ff2181bb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff2177fe700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2180cb8d0 0x7ff2180cbd20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff208006b50 tx=0x7ff20800eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff214ff9700 1 -- 172.21.15.57:0/1017583444 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff2180d2570 con 0x7ff2180cb8d0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff214ff9700 1 -- 172.21.15.57:0/1017583444 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20800c5a0 con 0x7ff2180cb8d0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2181b51d0 con 0x7ff2180cb8d0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff214ff9700 1 -- 172.21.15.57:0/1017583444 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff20800f040 con 0x7ff2180cb8d0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2181bbff0 con 0x7ff2180cb8d0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff214ff9700 1 -- 172.21.15.57:0/1017583444 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff208022060 con 0x7ff2180cb8d0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.960 7ff214ff9700 1 -- 172.21.15.57:0/1017583444 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1133+0+0 (secure 0 0 0) 0x7ff208010040 con 0x7ff2180cb8d0 2024-04-25T02:05:29.969 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.961 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2180f0860 con 0x7ff2180cb8d0 2024-04-25T02:05:29.970 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:29.963 7ff214ff9700 1 -- 172.21.15.57:0/1017583444 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7ff20800ede0 con 0x7ff2180cb8d0 2024-04-25T02:05:30.038 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.032 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2181aea00 con 0x7ff2180cb8d0 2024-04-25T02:05:30.039 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.033 7ff214ff9700 1 -- 172.21.15.57:0/1017583444 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3216 (secure 0 0 0) 0x7ff208000c30 con 0x7ff2180cb8d0 2024-04-25T02:05:30.040 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-25T02:05:30.041 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":6,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:29.080329","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:30.041 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2180cb8d0 msgr2=0x7ff2180cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:30.041 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2180cb8d0 0x7ff2180cbd20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff208006b50 tx=0x7ff20800eca0).stop 2024-04-25T02:05:30.041 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 shutdown_connections 2024-04-25T02:05:30.041 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff2181b4d80 0x7ff2181bb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:30.042 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2180cb8d0 0x7ff2180cbd20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:30.042 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 --2- 172.21.15.57:0/1017583444 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff2181b4300 0x7ff2181b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:30.042 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 >> 172.21.15.57:0/1017583444 conn(0x7ff2180dc5f0 msgr2=0x7ff2180baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:30.042 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 shutdown_connections 2024-04-25T02:05:30.042 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:30.035 7ff21eb90700 1 -- 172.21.15.57:0/1017583444 wait complete. 2024-04-25T02:05:30.059 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-25T02:05:31.127 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-04-25 02:05:31.121 7f54be596dc0 -1 osd.2 0 log_to_monitors {default=true} 2024-04-25T02:05:31.128 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-04-25 02:05:31.121 7f3456509dc0 -1 osd.1 0 log_to_monitors {default=true} 2024-04-25T02:05:31.153 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-04-25 02:05:31.147 7f8801479dc0 -1 osd.3 0 log_to_monitors {default=true} 2024-04-25T02:05:31.165 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25 02:05:31.159 7f39826f2dc0 -1 osd.0 0 log_to_monitors {default=true} 2024-04-25T02:05:32.693 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-04-25 02:05:32.686 7f343c226700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T02:05:32.706 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-04-25 02:05:32.700 7f3448444700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:05:32.707 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-04-25 02:05:32.701 7f54a42b3700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T02:05:32.707 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-04-25 02:05:32.701 7f87e7196700 -1 osd.3 0 waiting for initial osdmap 2024-04-25T02:05:32.708 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25 02:05:32.702 7f396840f700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T02:05:32.717 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-04-25 02:05:32.710 7f54b04d1700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:05:32.721 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25 02:05:32.715 7f397462d700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:05:32.722 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-04-25 02:05:32.715 7f87f33b4700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:05:36.463 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:36.599 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa96bbae700 1 Processor -- start 2024-04-25T02:05:36.599 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa96bbae700 1 -- start start 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa96bbae700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa96410cb40 0x7fa9641a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa96bbae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9641a6be0 0x7fa9641a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa96bbae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96410cf90 con 0x7fa9640f5920 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa96bbae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640fa290 con 0x7fa9641a6be0 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa96bbae700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640f95c0 con 0x7fa96410cb40 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa963fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa96410cb40 0x7fa9641a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa9691aa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9641a6be0 0x7fa9641a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa9689a9700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa9640f5920 0x7fa96410c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53936/0 (socket says 172.21.15.57:53936) 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa963fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa96410cb40 0x7fa9641a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37088/0 (socket says 172.21.15.57:37088) 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.591 7fa9689a9700 1 -- 172.21.15.57:0/929405949 learned_addr learned my addr 172.21.15.57:0/929405949 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa963fff700 1 -- 172.21.15.57:0/929405949 >> v2:172.21.15.57:3300/0 conn(0x7fa9641a6be0 msgr2=0x7fa9641a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa963fff700 1 --2- 172.21.15.57:0/929405949 >> v2:172.21.15.57:3300/0 conn(0x7fa9641a6be0 0x7fa9641a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa963fff700 1 -- 172.21.15.57:0/929405949 >> v1:172.21.15.57:6789/0 conn(0x7fa9640f5920 legacy=0x7fa96410c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.600 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa963fff700 1 -- 172.21.15.57:0/929405949 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9641aa680 con 0x7fa96410cb40 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa9637fe700 1 -- 172.21.15.57:0/929405949 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709872005 0 0) 0x7fa954001110 con 0x7fa9640f5920 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa9691aa700 1 --2- 172.21.15.57:0/929405949 >> v2:172.21.15.57:3300/0 conn(0x7fa9641a6be0 0x7fa9641a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa963fff700 1 --2- 172.21.15.57:0/929405949 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa96410cb40 0x7fa9641a65b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa94c002f70 tx=0x7fa94c00b970).ready entity=mon.2 client_cookie=9456281a776f8adc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa9637fe700 1 -- 172.21.15.57:0/929405949 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9641aa680 con 0x7fa96410cb40 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa9637fe700 1 -- 172.21.15.57:0/929405949 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c00d610 con 0x7fa96410cb40 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa9637fe700 1 -- 172.21.15.57:0/929405949 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa94c00d9e0 con 0x7fa96410cb40 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa96bbae700 1 -- 172.21.15.57:0/929405949 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa96410cb40 msgr2=0x7fa9641a65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.592 7fa96bbae700 1 --2- 172.21.15.57:0/929405949 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa96410cb40 0x7fa9641a65b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa94c002f70 tx=0x7fa94c00b970).stop 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.593 7fa96bbae700 1 -- 172.21.15.57:0/929405949 shutdown_connections 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.593 7fa96bbae700 1 --2- 172.21.15.57:0/929405949 >> v2:172.21.15.57:3300/0 conn(0x7fa9641a6be0 0x7fa9641a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.593 7fa96bbae700 1 --2- 172.21.15.57:0/929405949 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa96410cb40 0x7fa9641a65b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.593 7fa96bbae700 1 -- 172.21.15.57:0/929405949 >> 172.21.15.57:0/929405949 conn(0x7fa964113a70 msgr2=0x7fa9640f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.593 7fa96bbae700 1 -- 172.21.15.57:0/929405949 shutdown_connections 2024-04-25T02:05:36.601 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.593 7fa96bbae700 1 -- 172.21.15.57:0/929405949 wait complete. 2024-04-25T02:05:36.623 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.617 7fa96bbae700 1 Processor -- start 2024-04-25T02:05:36.623 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.617 7fa96bbae700 1 -- start start 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa96bbae700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa9641ac070 0x7fa9641ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa96bbae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9641b2540 0x7fa9641b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa96bbae700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9641b2fc0 0x7fa9641b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa96bbae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9641acaf0 con 0x7fa9641b2540 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa96bbae700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640c4bc0 con 0x7fa9641b2fc0 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa96bbae700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9641b3410 con 0x7fa9641ac070 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa9689a9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa9641ac070 0x7fa9641ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa963fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9641b2540 0x7fa9641b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa9689a9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa9641ac070 0x7fa9641ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37094/0 (socket says 172.21.15.57:37094) 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa9689a9700 1 -- 172.21.15.57:0/1693334445 learned_addr learned my addr 172.21.15.57:0/1693334445 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:36.626 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa9691aa700 1 --2- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9641b2fc0 0x7fa9641b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa963fff700 1 -- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa9641ac070 msgr2=0x7fa9641ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa963fff700 1 --2- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa9641ac070 0x7fa9641ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa963fff700 1 -- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9641b2fc0 msgr2=0x7fa9641b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa963fff700 1 --2- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9641b2fc0 0x7fa9641b9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa963fff700 1 -- 172.21.15.57:0/1693334445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640c43a0 con 0x7fa9641b2540 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa963fff700 1 --2- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9641b2540 0x7fa9641b2990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa94c002f70 tx=0x7fa94c00a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa961ffb700 1 -- 172.21.15.57:0/1693334445 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa9640c43a0 con 0x7fa9641b2540 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa961ffb700 1 -- 172.21.15.57:0/1693334445 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c0138d0 con 0x7fa9641b2540 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa961ffb700 1 -- 172.21.15.57:0/1693334445 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa94c013ca0 con 0x7fa9641b2540 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.618 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9640c3870 con 0x7fa9641b2540 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.619 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9641ba230 con 0x7fa9641b2540 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.619 7fa961ffb700 1 -- 172.21.15.57:0/1693334445 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa94c027070 con 0x7fa9641b2540 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.619 7fa961ffb700 1 -- 172.21.15.57:0/1693334445 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2021+0+0 (secure 0 0 0) 0x7fa94c008cc0 con 0x7fa9641b2540 2024-04-25T02:05:36.627 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.620 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9640f08e0 con 0x7fa9641b2540 2024-04-25T02:05:36.629 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.623 7fa961ffb700 1 -- 172.21.15.57:0/1693334445 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa94c0136c0 con 0x7fa9641b2540 2024-04-25T02:05:36.743 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.736 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9641acca0 con 0x7fa9641b2540 2024-04-25T02:05:36.743 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.737 7fa961ffb700 1 -- 172.21.15.57:0/1693334445 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4504 (secure 0 0 0) 0x7fa94c00d400 con 0x7fa9641b2540 2024-04-25T02:05:36.743 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-25T02:05:36.743 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":9,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:33.696326","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:36.745 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 >> v1:172.21.15.57:6816/43033 conn(0x7fa9480145b0 legacy=0x7fa948016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.745 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9641b2540 msgr2=0x7fa9641b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.745 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 --2- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9641b2540 0x7fa9641b2990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa94c002f70 tx=0x7fa94c00a040).stop 2024-04-25T02:05:36.745 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 shutdown_connections 2024-04-25T02:05:36.745 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 --2- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9641b2fc0 0x7fa9641b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.745 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 --2- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa9641ac070 0x7fa9641ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.746 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 --2- 172.21.15.57:0/1693334445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9641b2540 0x7fa9641b2990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.746 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 >> 172.21.15.57:0/1693334445 conn(0x7fa9640c5ae0 msgr2=0x7fa9640d71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:36.746 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 shutdown_connections 2024-04-25T02:05:36.746 INFO:teuthology.misc.health.smithi057.stderr:2024-04-25 02:05:36.738 7fa96bbae700 1 -- 172.21.15.57:0/1693334445 wait complete. 2024-04-25T02:05:36.754 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-25T02:05:36.755 INFO:tasks.ceph:Creating RBD pool 2024-04-25T02:05:36.755 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T02:05:36.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.878 7f143159c700 1 Processor -- start 2024-04-25T02:05:36.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.878 7f143159c700 1 -- start start 2024-04-25T02:05:36.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.878 7f143159c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c0f2090 0x7f142c1a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.878 7f143159c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f142c1a8c80 0x7f142c1ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f143159c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0f9230 con 0x7f142c0f5920 2024-04-25T02:05:36.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f143159c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c0f24e0 con 0x7f142c1a8c80 2024-04-25T02:05:36.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f143159c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0f26e0 con 0x7f142c0f2090 2024-04-25T02:05:36.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f142a2b1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f142c0f5920 0x7f142c0f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53938/0 (socket says 172.21.15.57:53938) 2024-04-25T02:05:36.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f142a2b1700 1 -- 172.21.15.57:0/1357021238 learned_addr learned my addr 172.21.15.57:0/1357021238 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f1429ab0700 1 --2- 172.21.15.57:0/1357021238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c0f2090 0x7f142c1a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f142aab2700 1 --2- 172.21.15.57:0/1357021238 >> v2:172.21.15.57:3300/0 conn(0x7f142c1a8c80 0x7f142c1ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f14292af700 1 -- 172.21.15.57:0/1357021238 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900787451 0 0) 0x7f141c001110 con 0x7f142c0f5920 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f14292af700 1 -- 172.21.15.57:0/1357021238 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f140c003270 con 0x7f142c0f5920 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f1429ab0700 1 -- 172.21.15.57:0/1357021238 >> v2:172.21.15.57:3300/0 conn(0x7f142c1a8c80 msgr2=0x7f142c1ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f1429ab0700 1 --2- 172.21.15.57:0/1357021238 >> v2:172.21.15.57:3300/0 conn(0x7f142c1a8c80 0x7f142c1ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f1429ab0700 1 -- 172.21.15.57:0/1357021238 >> v1:172.21.15.57:6789/0 conn(0x7f142c0f5920 legacy=0x7f142c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f1429ab0700 1 -- 172.21.15.57:0/1357021238 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c1ac720 con 0x7f142c0f2090 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f1429ab0700 1 --2- 172.21.15.57:0/1357021238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c0f2090 0x7f142c1a8650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f1414002f70 tx=0x7f141400b970).ready entity=mon.2 client_cookie=1611ef9e8ecdb79b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f14292af700 1 -- 172.21.15.57:0/1357021238 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f142c1ac720 con 0x7f142c0f2090 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f14292af700 1 -- 172.21.15.57:0/1357021238 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141400d5c0 con 0x7f142c0f2090 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f14292af700 1 -- 172.21.15.57:0/1357021238 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f141400d9e0 con 0x7f142c0f2090 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f143159c700 1 -- 172.21.15.57:0/1357021238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c0f2090 msgr2=0x7f142c1a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.879 7f143159c700 1 --2- 172.21.15.57:0/1357021238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c0f2090 0x7f142c1a8650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f1414002f70 tx=0x7f141400b970).stop 2024-04-25T02:05:36.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.880 7f143159c700 1 -- 172.21.15.57:0/1357021238 shutdown_connections 2024-04-25T02:05:36.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.880 7f143159c700 1 --2- 172.21.15.57:0/1357021238 >> v2:172.21.15.57:3300/0 conn(0x7f142c1a8c80 0x7f142c1ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.880 7f143159c700 1 --2- 172.21.15.57:0/1357021238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c0f2090 0x7f142c1a8650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.880 7f143159c700 1 -- 172.21.15.57:0/1357021238 >> 172.21.15.57:0/1357021238 conn(0x7f142c113a70 msgr2=0x7f142c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:36.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.880 7f143159c700 1 -- 172.21.15.57:0/1357021238 shutdown_connections 2024-04-25T02:05:36.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.880 7f143159c700 1 -- 172.21.15.57:0/1357021238 wait complete. 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f143159c700 1 Processor -- start 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f143159c700 1 -- start start 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f143159c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f142c1a51a0 0x7f142c1a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f143159c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f142c1a5c20 0x7f142c1b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f143159c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c1b1d30 0x7f142c1bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f143159c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0de810 con 0x7f142c1a5c20 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f143159c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c1a61f0 con 0x7f142c1a51a0 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f143159c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0c7810 con 0x7f142c1b1d30 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f1429ab0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f142c1a5c20 0x7f142c1b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f142a2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f142c1a51a0 0x7f142c1a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f142aab2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c1b1d30 0x7f142c1bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f1429ab0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f142c1a5c20 0x7f142c1b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43640/0 (socket says 172.21.15.57:43640) 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f142aab2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c1b1d30 0x7f142c1bc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37118/0 (socket says 172.21.15.57:37118) 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f1429ab0700 1 -- 172.21.15.57:0/1613252900 learned_addr learned my addr 172.21.15.57:0/1613252900 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.904 7f142a2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f142c1a51a0 0x7f142c1a55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39290/0 (socket says 172.21.15.57:39290) 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f1429ab0700 1 -- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c1b1d30 msgr2=0x7f142c1bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f1429ab0700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c1b1d30 0x7f142c1bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f1429ab0700 1 -- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f142c1a51a0 msgr2=0x7f142c1a55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f1429ab0700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f142c1a51a0 0x7f142c1a55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f1429ab0700 1 -- 172.21.15.57:0/1613252900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c1b2180 con 0x7f142c1a5c20 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f142aab2700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c1b1d30 0x7f142c1bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f142a2b1700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f142c1a51a0 0x7f142c1a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f1429ab0700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f142c1a5c20 0x7f142c1b1700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f1414002f70 tx=0x7f14140068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f14237fe700 1 -- 172.21.15.57:0/1613252900 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f142c1b2180 con 0x7f142c1a5c20 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f14237fe700 1 -- 172.21.15.57:0/1613252900 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1414011a00 con 0x7f142c1a5c20 2024-04-25T02:05:36.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f143159c700 1 -- 172.21.15.57:0/1613252900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c1b2440 con 0x7f142c1a5c20 2024-04-25T02:05:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f14237fe700 1 -- 172.21.15.57:0/1613252900 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1414017040 con 0x7f142c1a5c20 2024-04-25T02:05:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.905 7f143159c700 1 -- 172.21.15.57:0/1613252900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c1bc8f0 con 0x7f142c1a5c20 2024-04-25T02:05:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.906 7f14237fe700 1 -- 172.21.15.57:0/1613252900 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f141401b370 con 0x7f142c1a5c20 2024-04-25T02:05:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.906 7f14237fe700 1 -- 172.21.15.57:0/1613252900 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2021+0+0 (secure 0 0 0) 0x7f1414018030 con 0x7f142c1a5c20 2024-04-25T02:05:36.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.906 7f143159c700 1 -- 172.21.15.57:0/1613252900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c0f08e0 con 0x7f142c1a5c20 2024-04-25T02:05:36.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:36.910 7f14237fe700 1 -- 172.21.15.57:0/1613252900 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f14140117f0 con 0x7f142c1a5c20 2024-04-25T02:05:37.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.019 7f143159c700 1 -- 172.21.15.57:0/1613252900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f142c0d5590 con 0x7f142c1a5c20 2024-04-25T02:05:37.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.727 7f14237fe700 1 -- 172.21.15.57:0/1613252900 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7f141400d3b0 con 0x7f142c1a5c20 2024-04-25T02:05:37.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.731 7f143159c700 1 -- 172.21.15.57:0/1613252900 >> v1:172.21.15.57:6816/43033 conn(0x7f14100145b0 legacy=0x7f1410016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.731 7f143159c700 1 -- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f142c1a5c20 msgr2=0x7f142c1b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.731 7f143159c700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f142c1a5c20 0x7f142c1b1700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f1414002f70 tx=0x7f14140068c0).stop 2024-04-25T02:05:37.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.732 7f143159c700 1 -- 172.21.15.57:0/1613252900 shutdown_connections 2024-04-25T02:05:37.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.732 7f143159c700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f142c1b1d30 0x7f142c1bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:37.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.732 7f143159c700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f142c1a51a0 0x7f142c1a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:37.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.732 7f143159c700 1 --2- 172.21.15.57:0/1613252900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f142c1a5c20 0x7f142c1b1700 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:37.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.732 7f143159c700 1 -- 172.21.15.57:0/1613252900 >> 172.21.15.57:0/1613252900 conn(0x7f142c1a7b50 msgr2=0x7f142c0da9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:37.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.732 7f143159c700 1 -- 172.21.15.57:0/1613252900 shutdown_connections 2024-04-25T02:05:37.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.732 7f143159c700 1 -- 172.21.15.57:0/1613252900 wait complete. 2024-04-25T02:05:37.740 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'rbd' created 2024-04-25T02:05:37.752 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T02:05:37.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.885 7f5e1ee18700 1 Processor -- start 2024-04-25T02:05:37.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.885 7f5e1ee18700 1 -- start start 2024-04-25T02:05:37.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e1ee18700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180f2000 0x7f5e181a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:37.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e1ee18700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181a8bf0 0x7f5e181ab050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:37.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e1ee18700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e180f91a0 con 0x7f5e180f5890 2024-04-25T02:05:37.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e1ee18700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180f2450 con 0x7f5e181a8bf0 2024-04-25T02:05:37.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e1ee18700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e181ac690 con 0x7f5e180f2000 2024-04-25T02:05:37.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e17fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181a8bf0 0x7f5e181ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e16ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180f2000 0x7f5e181a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e177fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5e180f5890 0x7f5e180f1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53952/0 (socket says 172.21.15.57:53952) 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e177fe700 1 -- 172.21.15.57:0/2651183221 learned_addr learned my addr 172.21.15.57:0/2651183221 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e167fc700 1 -- 172.21.15.57:0/2651183221 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598038518 0 0) 0x7f5e08001110 con 0x7f5e180f5890 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e16ffd700 1 -- 172.21.15.57:0/2651183221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181a8bf0 msgr2=0x7f5e181ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e16ffd700 1 --2- 172.21.15.57:0/2651183221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181a8bf0 0x7f5e181ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e16ffd700 1 -- 172.21.15.57:0/2651183221 >> v1:172.21.15.57:6789/0 conn(0x7f5e180f5890 legacy=0x7f5e180f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e16ffd700 1 -- 172.21.15.57:0/2651183221 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e181ac840 con 0x7f5e180f2000 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e17fff700 1 --2- 172.21.15.57:0/2651183221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181a8bf0 0x7f5e181ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.886 7f5e16ffd700 1 --2- 172.21.15.57:0/2651183221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180f2000 0x7f5e181a85c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5e00002f70 tx=0x7f5e0000b9a0).ready entity=mon.2 client_cookie=a1ace768b66810bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e167fc700 1 -- 172.21.15.57:0/2651183221 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e181ac840 con 0x7f5e180f2000 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e167fc700 1 -- 172.21.15.57:0/2651183221 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0000d570 con 0x7f5e180f2000 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e167fc700 1 -- 172.21.15.57:0/2651183221 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e0000d940 con 0x7f5e180f2000 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e1ee18700 1 -- 172.21.15.57:0/2651183221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180f2000 msgr2=0x7f5e181a85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e1ee18700 1 --2- 172.21.15.57:0/2651183221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180f2000 0x7f5e181a85c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f5e00002f70 tx=0x7f5e0000b9a0).stop 2024-04-25T02:05:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e1ee18700 1 -- 172.21.15.57:0/2651183221 shutdown_connections 2024-04-25T02:05:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e1ee18700 1 --2- 172.21.15.57:0/2651183221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181a8bf0 0x7f5e181ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e1ee18700 1 --2- 172.21.15.57:0/2651183221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180f2000 0x7f5e181a85c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e1ee18700 1 -- 172.21.15.57:0/2651183221 >> 172.21.15.57:0/2651183221 conn(0x7f5e181139e0 msgr2=0x7f5e180f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e1ee18700 1 -- 172.21.15.57:0/2651183221 shutdown_connections 2024-04-25T02:05:37.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.887 7f5e1ee18700 1 -- 172.21.15.57:0/2651183221 wait complete. 2024-04-25T02:05:37.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.911 7f5e1ee18700 1 Processor -- start 2024-04-25T02:05:37.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.911 7f5e1ee18700 1 -- start start 2024-04-25T02:05:37.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e1ee18700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e180c3730 0x7f5e180c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e1ee18700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180c41b0 0x7f5e181b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e1ee18700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181b4ef0 0x7f5e181bbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e1ee18700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180d2a30 con 0x7f5e180c3730 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e1ee18700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180cf110 con 0x7f5e181b4ef0 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e1ee18700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180c4e30 con 0x7f5e180c41b0 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e180c3730 0x7f5e180c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e16ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180c41b0 0x7f5e181b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e17fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181b4ef0 0x7f5e181bbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e180c3730 0x7f5e180c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43648/0 (socket says 172.21.15.57:43648) 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e177fe700 1 -- 172.21.15.57:0/1888389095 learned_addr learned my addr 172.21.15.57:0/1888389095 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e16ffd700 1 -- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181b4ef0 msgr2=0x7f5e181bbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e16ffd700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181b4ef0 0x7f5e181bbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:37.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e16ffd700 1 -- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e180c3730 msgr2=0x7f5e180c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e16ffd700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e180c3730 0x7f5e180c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e16ffd700 1 -- 172.21.15.57:0/1888389095 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e180d82b0 con 0x7f5e180c41b0 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e177fe700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e180c3730 0x7f5e180c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e17fff700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181b4ef0 0x7f5e181bbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e16ffd700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180c41b0 0x7f5e181b48c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5e180d9730 tx=0x7f5e000068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e14ff9700 1 -- 172.21.15.57:0/1888389095 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e180d82b0 con 0x7f5e180c41b0 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e14ff9700 1 -- 172.21.15.57:0/1888389095 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00011940 con 0x7f5e180c41b0 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e14ff9700 1 -- 172.21.15.57:0/1888389095 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e00017040 con 0x7f5e180c41b0 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.912 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e181b5340 con 0x7f5e180c41b0 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.913 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e181bc140 con 0x7f5e180c41b0 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.913 7f5e14ff9700 1 -- 172.21.15.57:0/1888389095 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5e00011d10 con 0x7f5e180c41b0 2024-04-25T02:05:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.913 7f5e14ff9700 1 -- 172.21.15.57:0/1888389095 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2363+0+0 (secure 0 0 0) 0x7f5e00018070 con 0x7f5e180c41b0 2024-04-25T02:05:37.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.914 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e180f0850 con 0x7f5e180c41b0 2024-04-25T02:05:37.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:37.917 7f5e14ff9700 1 -- 172.21.15.57:0/1888389095 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5e00011730 con 0x7f5e180c41b0 2024-04-25T02:05:38.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.030 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5e180ce880 con 0x7f5e180c41b0 2024-04-25T02:05:38.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.736 7f5e14ff9700 1 -- 172.21.15.57:0/1888389095 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5e0000d360 con 0x7f5e180c41b0 2024-04-25T02:05:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.739 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 >> v1:172.21.15.57:6816/43033 conn(0x7f5dfc0145b0 legacy=0x7f5dfc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.739 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180c41b0 msgr2=0x7f5e181b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.739 7f5e1ee18700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180c41b0 0x7f5e181b48c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5e180d9730 tx=0x7f5e000068c0).stop 2024-04-25T02:05:38.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.740 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 shutdown_connections 2024-04-25T02:05:38.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.740 7f5e1ee18700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e181b4ef0 0x7f5e181bbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.741 7f5e1ee18700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e180c3730 0x7f5e180c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.741 7f5e1ee18700 1 --2- 172.21.15.57:0/1888389095 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5e180c41b0 0x7f5e181b48c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.741 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 >> 172.21.15.57:0/1888389095 conn(0x7f5e180c5cc0 msgr2=0x7f5e180d86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.742 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 shutdown_connections 2024-04-25T02:05:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.742 7f5e1ee18700 1 -- 172.21.15.57:0/1888389095 wait complete. 2024-04-25T02:05:38.750 INFO:teuthology.orchestra.run.smithi057.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T02:05:38.762 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T02:05:38.762 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:05:38.762 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:05:38.765 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:05:38.765 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T02:05:38.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:38.843 INFO:tasks.ceph.mds.a.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:05:38.895 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-04-25T02:05:38.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.898 7f60820cd700 1 Processor -- start 2024-04-25T02:05:38.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.898 7f60820cd700 1 -- start start 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f60820cd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0f5a10 0x7f607c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f60820cd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f607c10b740 0x7f607c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f60820cd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c10bb90 0x7f607c1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f60820cd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c0fa590 con 0x7f607c10b740 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f60820cd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c1a08a0 con 0x7f607c10bb90 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f60820cd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f607c1a0ad0 con 0x7f607c0f5a10 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0f5a10 0x7f607c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607a5c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f607c10b740 0x7f607c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0f5a10 0x7f607c10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37166/0 (socket says 172.21.15.57:37166) 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 -- 172.21.15.57:0/1842410544 learned_addr learned my addr 172.21.15.57:0/1842410544 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607b5c7700 1 --2- 172.21.15.57:0/1842410544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c10bb90 0x7f607c1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 -- 172.21.15.57:0/1842410544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c10bb90 msgr2=0x7f607c1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:38.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 --2- 172.21.15.57:0/1842410544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c10bb90 0x7f607c1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 -- 172.21.15.57:0/1842410544 >> v2:172.21.15.57:3300/0 conn(0x7f607c10b740 msgr2=0x7f607c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 --2- 172.21.15.57:0/1842410544 >> v2:172.21.15.57:3300/0 conn(0x7f607c10b740 0x7f607c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 -- 172.21.15.57:0/1842410544 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c1a73b0 con 0x7f607c0f5a10 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607a5c5700 1 --2- 172.21.15.57:0/1842410544 >> v2:172.21.15.57:3300/0 conn(0x7f607c10b740 0x7f607c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f607adc6700 1 --2- 172.21.15.57:0/1842410544 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0f5a10 0x7f607c10b110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f607c0f47c0 tx=0x7f6074009d90).ready entity=mon.2 client_cookie=86dc0ca79617b4cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f6079dc4700 1 -- 172.21.15.57:0/1842410544 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f607c1a73b0 con 0x7f607c0f5a10 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f6079dc4700 1 -- 172.21.15.57:0/1842410544 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607400b840 con 0x7f607c0f5a10 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f6079dc4700 1 -- 172.21.15.57:0/1842410544 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f607400ba20 con 0x7f607c0f5a10 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f60820cd700 1 -- 172.21.15.57:0/1842410544 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0f5a10 msgr2=0x7f607c10b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.899 7f60820cd700 1 --2- 172.21.15.57:0/1842410544 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0f5a10 0x7f607c10b110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f607c0f47c0 tx=0x7f6074009d90).stop 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.900 7f60820cd700 1 -- 172.21.15.57:0/1842410544 shutdown_connections 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.900 7f60820cd700 1 --2- 172.21.15.57:0/1842410544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c10bb90 0x7f607c1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.900 7f60820cd700 1 --2- 172.21.15.57:0/1842410544 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0f5a10 0x7f607c10b110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.900 7f60820cd700 1 --2- 172.21.15.57:0/1842410544 >> v2:172.21.15.57:3300/0 conn(0x7f607c10b740 0x7f607c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.900 7f60820cd700 1 -- 172.21.15.57:0/1842410544 >> 172.21.15.57:0/1842410544 conn(0x7f607c113a70 msgr2=0x7f607c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:38.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.900 7f60820cd700 1 -- 172.21.15.57:0/1842410544 shutdown_connections 2024-04-25T02:05:38.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.900 7f60820cd700 1 -- 172.21.15.57:0/1842410544 wait complete. 2024-04-25T02:05:38.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.924 7f60820cd700 1 Processor -- start 2024-04-25T02:05:38.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.924 7f60820cd700 1 -- start start 2024-04-25T02:05:38.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f60820cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f607c0d9bd0 0x7f607c0da020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f60820cd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0da650 0x7f607c1b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f60820cd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c1b4f10 0x7f607c1b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f60820cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0de3c0 con 0x7f607c0d9bd0 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f60820cd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0f1db0 con 0x7f607c1b4f10 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f60820cd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0de6c0 con 0x7f607c0da650 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607adc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f607c0d9bd0 0x7f607c0da020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607a5c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0da650 0x7f607c1b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607b5c7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c1b4f10 0x7f607c1b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607adc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f607c0d9bd0 0x7f607c0da020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43670/0 (socket says 172.21.15.57:43670) 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607adc6700 1 -- 172.21.15.57:0/292427005 learned_addr learned my addr 172.21.15.57:0/292427005 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607b5c7700 1 -- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0da650 msgr2=0x7f607c1b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607b5c7700 1 --2- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0da650 0x7f607c1b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607b5c7700 1 -- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f607c0d9bd0 msgr2=0x7f607c0da020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:38.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607b5c7700 1 --2- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f607c0d9bd0 0x7f607c0da020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607b5c7700 1 -- 172.21.15.57:0/292427005 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c1a1970 con 0x7f607c1b4f10 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607a5c5700 1 --2- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0da650 0x7f607c1b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f607b5c7700 1 --2- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c1b4f10 0x7f607c1b5360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f607c0c5f90 tx=0x7f606c00ec70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f606bfff700 1 -- 172.21.15.57:0/292427005 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f607c1a1970 con 0x7f607c1b4f10 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f606bfff700 1 -- 172.21.15.57:0/292427005 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00c790 con 0x7f607c1b4f10 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f60820cd700 1 -- 172.21.15.57:0/292427005 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c1bbfd0 con 0x7f607c1b4f10 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f606bfff700 1 -- 172.21.15.57:0/292427005 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f606c00f040 con 0x7f607c1b4f10 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.925 7f60820cd700 1 -- 172.21.15.57:0/292427005 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c1bc3b0 con 0x7f607c1b4f10 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.926 7f606bfff700 1 -- 172.21.15.57:0/292427005 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f606c011070 con 0x7f607c1b4f10 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.926 7f606bfff700 1 -- 172.21.15.57:0/292427005 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f606c010040 con 0x7f607c1b4f10 2024-04-25T02:05:38.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.927 7f60820cd700 1 -- 172.21.15.57:0/292427005 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c0f08e0 con 0x7f607c1b4f10 2024-04-25T02:05:38.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:38.930 7f606bfff700 1 -- 172.21.15.57:0/292427005 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f606c00edb0 con 0x7f607c1b4f10 2024-04-25T02:05:39.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.040 7f60820cd700 1 -- 172.21.15.57:0/292427005 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f607c0e2430 con 0x7f607c1b4f10 2024-04-25T02:05:39.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.041 7f606bfff700 1 -- 172.21.15.57:0/292427005 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+5885 (secure 0 0 0) 0x7f607c1145f0 con 0x7f607c1b4f10 2024-04-25T02:05:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:39.048 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:38.726281","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:39.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 -- 172.21.15.57:0/292427005 >> v1:172.21.15.57:6816/43033 conn(0x7f60580145b0 legacy=0x7f6058016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 -- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c1b4f10 msgr2=0x7f607c1b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 --2- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c1b4f10 0x7f607c1b5360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f607c0c5f90 tx=0x7f606c00ec70).stop 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 -- 172.21.15.57:0/292427005 shutdown_connections 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 --2- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f607c1b4f10 0x7f607c1b5360 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 --2- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f607c0d9bd0 0x7f607c0da020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 --2- 172.21.15.57:0/292427005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f607c0da650 0x7f607c1b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 -- 172.21.15.57:0/292427005 >> 172.21.15.57:0/292427005 conn(0x7f607c0f1890 msgr2=0x7f607c0d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 -- 172.21.15.57:0/292427005 shutdown_connections 2024-04-25T02:05:39.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.042 7f60820cd700 1 -- 172.21.15.57:0/292427005 wait complete. 2024-04-25T02:05:39.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-25T02:05:39.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:05:39.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.186 7f6dd127b700 1 Processor -- start 2024-04-25T02:05:39.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dd127b700 1 -- start start 2024-04-25T02:05:39.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dd127b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6dcc10b910 0x7f6dcc1a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dd127b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1a59d0 0x7f6dcc1a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dd127b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc10bd60 con 0x7f6dcc0f5a10 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dd127b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc0fa590 con 0x7f6dcc10b910 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dd127b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1a0c50 con 0x7f6dcc1a59d0 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dca85d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1a59d0 0x7f6dcc1a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dc985b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6dcc10b910 0x7f6dcc1a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dca85d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1a59d0 0x7f6dcc1a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39350/0 (socket says 172.21.15.57:39350) 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.187 7f6dca85d700 1 -- 172.21.15.57:0/2571220971 learned_addr learned my addr 172.21.15.57:0/2571220971 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc985b700 1 -- 172.21.15.57:0/2571220971 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1a59d0 msgr2=0x7f6dcc1a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc985b700 1 --2- 172.21.15.57:0/2571220971 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1a59d0 0x7f6dcc1a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc985b700 1 -- 172.21.15.57:0/2571220971 >> v1:172.21.15.57:6789/0 conn(0x7f6dcc0f5a10 legacy=0x7f6dcc10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc985b700 1 -- 172.21.15.57:0/2571220971 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc1a9470 con 0x7f6dcc10b910 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc905a700 1 -- 172.21.15.57:0/2571220971 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850748495 0 0) 0x7f6dbc001110 con 0x7f6dcc0f5a10 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dca85d700 1 --2- 172.21.15.57:0/2571220971 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1a59d0 0x7f6dcc1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc985b700 1 --2- 172.21.15.57:0/2571220971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc10b910 0x7f6dcc1a53a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6dcc103a10 tx=0x7f6db400ba20).ready entity=mon.0 client_cookie=19b4992ad895a373 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc905a700 1 -- 172.21.15.57:0/2571220971 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6dcc1a9470 con 0x7f6dcc10b910 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc905a700 1 -- 172.21.15.57:0/2571220971 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db400d5c0 con 0x7f6dcc10b910 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dc905a700 1 -- 172.21.15.57:0/2571220971 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6db400d990 con 0x7f6dcc10b910 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dd127b700 1 -- 172.21.15.57:0/2571220971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc10b910 msgr2=0x7f6dcc1a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.188 7f6dd127b700 1 --2- 172.21.15.57:0/2571220971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc10b910 0x7f6dcc1a53a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6dcc103a10 tx=0x7f6db400ba20).stop 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.189 7f6dd127b700 1 -- 172.21.15.57:0/2571220971 shutdown_connections 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.189 7f6dd127b700 1 --2- 172.21.15.57:0/2571220971 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1a59d0 0x7f6dcc1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.189 7f6dd127b700 1 --2- 172.21.15.57:0/2571220971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc10b910 0x7f6dcc1a53a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.189 7f6dd127b700 1 -- 172.21.15.57:0/2571220971 >> 172.21.15.57:0/2571220971 conn(0x7f6dcc113a70 msgr2=0x7f6dcc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:39.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.189 7f6dd127b700 1 -- 172.21.15.57:0/2571220971 shutdown_connections 2024-04-25T02:05:39.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.189 7f6dd127b700 1 -- 172.21.15.57:0/2571220971 wait complete. 2024-04-25T02:05:39.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.212 7f6dd127b700 1 Processor -- start 2024-04-25T02:05:39.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.212 7f6dd127b700 1 -- start start 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dd127b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6dcc0cc3d0 0x7f6dcc0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dd127b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc0cce50 0x7f6dcc1b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dd127b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1b0b10 0x7f6dcc1b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dd127b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0dc860 con 0x7f6dcc0cce50 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dd127b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0dceb0 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dd127b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0c3cc0 con 0x7f6dcc0cc3d0 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dc985b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc0cce50 0x7f6dcc1b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dca05c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6dcc0cc3d0 0x7f6dcc0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dc985b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc0cce50 0x7f6dcc1b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43690/0 (socket says 172.21.15.57:43690) 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dc985b700 1 -- 172.21.15.57:0/3793604192 learned_addr learned my addr 172.21.15.57:0/3793604192 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dca85d700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1b0b10 0x7f6dcc1b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dca85d700 1 -- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6dcc0cc3d0 msgr2=0x7f6dcc0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dca85d700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6dcc0cc3d0 0x7f6dcc0cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dca85d700 1 -- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc0cce50 msgr2=0x7f6dcc1b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dca85d700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc0cce50 0x7f6dcc1b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dca85d700 1 -- 172.21.15.57:0/3793604192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0dcb60 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dc985b700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc0cce50 0x7f6dcc1b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.213 7f6dca85d700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1b0b10 0x7f6dcc1b0f60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f6dcc0dca10 tx=0x7f6dc400ee20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.214 7f6dc37fe700 1 -- 172.21.15.57:0/3793604192 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6dcc0dcb60 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.214 7f6dc37fe700 1 -- 172.21.15.57:0/3793604192 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc400c820 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.214 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc0dd660 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.214 7f6dc37fe700 1 -- 172.21.15.57:0/3793604192 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6dc400f040 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.214 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc1b7ec0 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.214 7f6dc37fe700 1 -- 172.21.15.57:0/3793604192 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6dc4022060 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.214 7f6dc37fe700 1 -- 172.21.15.57:0/3793604192 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f6dc4010040 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.215 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc0f08e0 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.218 7f6dc37fe700 1 -- 172.21.15.57:0/3793604192 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f6dc400c610 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.331 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6dcc1aac00 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.331 7f6dc37fe700 1 -- 172.21.15.57:0/3793604192 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6dcc1145f0 con 0x7f6dcc1b0b10 2024-04-25T02:05:39.338 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:05:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.332 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 >> v1:172.21.15.57:6816/43033 conn(0x7f6db00145b0 legacy=0x7f6db0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.332 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1b0b10 msgr2=0x7f6dcc1b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.332 7f6dd127b700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1b0b10 0x7f6dcc1b0f60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f6dcc0dca10 tx=0x7f6dc400ee20).stop 2024-04-25T02:05:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.332 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 shutdown_connections 2024-04-25T02:05:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.332 7f6dd127b700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6dcc1b0b10 0x7f6dcc1b0f60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.332 7f6dd127b700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6dcc0cc3d0 0x7f6dcc0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.332 7f6dd127b700 1 --2- 172.21.15.57:0/3793604192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6dcc0cce50 0x7f6dcc1b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.332 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 >> 172.21.15.57:0/3793604192 conn(0x7f6dcc0e0b40 msgr2=0x7f6dcc0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.333 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 shutdown_connections 2024-04-25T02:05:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.333 7f6dd127b700 1 -- 172.21.15.57:0/3793604192 wait complete. 2024-04-25T02:05:39.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:05:39.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.474 7f765751a700 1 Processor -- start 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f765751a700 1 -- start start 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f765751a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f765010b910 0x7f76501a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f765751a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a59d0 0x7f76501a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f765751a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765010bd60 con 0x7f76500f5a10 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f765751a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500fa590 con 0x7f765010b910 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f765751a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76501a0c50 con 0x7f76501a59d0 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f764f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f765010b910 0x7f76501a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f7654b16700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a59d0 0x7f76501a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f764ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f76500f5a10 0x7f765010b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53976/0 (socket says 172.21.15.57:53976) 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.475 7f764ffff700 1 -- 172.21.15.57:0/3822296822 learned_addr learned my addr 172.21.15.57:0/3822296822 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764f7fe700 1 -- 172.21.15.57:0/3822296822 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a59d0 msgr2=0x7f76501a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764f7fe700 1 --2- 172.21.15.57:0/3822296822 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a59d0 0x7f76501a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764f7fe700 1 -- 172.21.15.57:0/3822296822 >> v1:172.21.15.57:6789/0 conn(0x7f76500f5a10 legacy=0x7f765010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764effd700 1 -- 172.21.15.57:0/3822296822 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509425054 0 0) 0x7f7640001110 con 0x7f76500f5a10 2024-04-25T02:05:39.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764f7fe700 1 -- 172.21.15.57:0/3822296822 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76501a9470 con 0x7f765010b910 2024-04-25T02:05:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764f7fe700 1 --2- 172.21.15.57:0/3822296822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f765010b910 0x7f76501a53a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f7650103a10 tx=0x7f764400ba50).ready entity=mon.1 client_cookie=16c2f15d55dcf687 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764effd700 1 -- 172.21.15.57:0/3822296822 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76501a9470 con 0x7f765010b910 2024-04-25T02:05:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764effd700 1 -- 172.21.15.57:0/3822296822 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764400d570 con 0x7f765010b910 2024-04-25T02:05:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f764effd700 1 -- 172.21.15.57:0/3822296822 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f764400d940 con 0x7f765010b910 2024-04-25T02:05:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f765751a700 1 -- 172.21.15.57:0/3822296822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f765010b910 msgr2=0x7f76501a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f765751a700 1 --2- 172.21.15.57:0/3822296822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f765010b910 0x7f76501a53a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f7650103a10 tx=0x7f764400ba50).stop 2024-04-25T02:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f765751a700 1 -- 172.21.15.57:0/3822296822 shutdown_connections 2024-04-25T02:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f765751a700 1 --2- 172.21.15.57:0/3822296822 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a59d0 0x7f76501a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f765751a700 1 --2- 172.21.15.57:0/3822296822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f765010b910 0x7f76501a53a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.476 7f765751a700 1 -- 172.21.15.57:0/3822296822 >> 172.21.15.57:0/3822296822 conn(0x7f7650113a70 msgr2=0x7f76500f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.477 7f765751a700 1 -- 172.21.15.57:0/3822296822 shutdown_connections 2024-04-25T02:05:39.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.477 7f765751a700 1 -- 172.21.15.57:0/3822296822 wait complete. 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.500 7f765751a700 1 Processor -- start 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.500 7f765751a700 1 -- start start 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f765751a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a1790 0x7f76500d9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f765751a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76500da0b0 0x7f76501b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f765751a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76500da500 0x7f76501b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f765751a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500de5c0 con 0x7f76500da0b0 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f765751a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76501a11c0 con 0x7f76500da500 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f765751a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76501b53c0 con 0x7f76501a1790 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a1790 0x7f76500d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76500da0b0 0x7f76501b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f7654b16700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76500da500 0x7f76501b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a1790 0x7f76500d9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37202/0 (socket says 172.21.15.57:37202) 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764ffff700 1 -- 172.21.15.57:0/4084466915 learned_addr learned my addr 172.21.15.57:0/4084466915 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764f7fe700 1 -- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a1790 msgr2=0x7f76500d9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764f7fe700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a1790 0x7f76500d9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764f7fe700 1 -- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76500da500 msgr2=0x7f76501b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764f7fe700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76500da500 0x7f76501b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.501 7f764f7fe700 1 -- 172.21.15.57:0/4084466915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76501b55f0 con 0x7f76500da0b0 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f7654b16700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76500da500 0x7f76501b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f764ffff700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a1790 0x7f76500d9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f764f7fe700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76500da0b0 0x7f76501b4760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f76500c5410 tx=0x7f76440068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f764d7fa700 1 -- 172.21.15.57:0/4084466915 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76501b55f0 con 0x7f76500da0b0 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f764d7fa700 1 -- 172.21.15.57:0/4084466915 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644011860 con 0x7f76500da0b0 2024-04-25T02:05:39.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f765751a700 1 -- 172.21.15.57:0/4084466915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76501bbe50 con 0x7f76500da0b0 2024-04-25T02:05:39.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f764d7fa700 1 -- 172.21.15.57:0/4084466915 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7644022020 con 0x7f76500da0b0 2024-04-25T02:05:39.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f765751a700 1 -- 172.21.15.57:0/4084466915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76501bc230 con 0x7f76500da0b0 2024-04-25T02:05:39.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f764d7fa700 1 -- 172.21.15.57:0/4084466915 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7644011c30 con 0x7f76500da0b0 2024-04-25T02:05:39.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.502 7f764d7fa700 1 -- 172.21.15.57:0/4084466915 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f7644009a80 con 0x7f76500da0b0 2024-04-25T02:05:39.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.503 7f765751a700 1 -- 172.21.15.57:0/4084466915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500f08e0 con 0x7f76500da0b0 2024-04-25T02:05:39.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.507 7f764d7fa700 1 -- 172.21.15.57:0/4084466915 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7644011650 con 0x7f76500da0b0 2024-04-25T02:05:39.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.648 7f765751a700 1 -- 172.21.15.57:0/4084466915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76500e2430 con 0x7f76500da0b0 2024-04-25T02:05:39.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.648 7f764d7fa700 1 -- 172.21.15.57:0/4084466915 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7f764400d360 con 0x7f76500da0b0 2024-04-25T02:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:39.655 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2024-04-25T02:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 -- 172.21.15.57:0/4084466915 >> v1:172.21.15.57:6816/43033 conn(0x7f76300145b0 legacy=0x7f7630016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 -- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76500da0b0 msgr2=0x7f76501b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76500da0b0 0x7f76501b4760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f76500c5410 tx=0x7f76440068c0).stop 2024-04-25T02:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 -- 172.21.15.57:0/4084466915 shutdown_connections 2024-04-25T02:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76500da500 0x7f76501b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76501a1790 0x7f76500d9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 --2- 172.21.15.57:0/4084466915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76500da0b0 0x7f76501b4760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 -- 172.21.15.57:0/4084466915 >> 172.21.15.57:0/4084466915 conn(0x7f76500dabf0 msgr2=0x7f76500d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.649 7f765751a700 1 -- 172.21.15.57:0/4084466915 shutdown_connections 2024-04-25T02:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:39.650 7f765751a700 1 -- 172.21.15.57:0/4084466915 wait complete. 2024-04-25T02:05:39.657 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 1 2024-04-25T02:05:41.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.807 7f467d6d3700 1 Processor -- start 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f467d6d3700 1 -- start start 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f467d6d3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f467810cb40 0x7f46781a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f467d6d3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46781a6be0 0x7f46781a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f467d6d3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467810cf90 con 0x7f46780f5920 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f467d6d3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46780fa290 con 0x7f467810cb40 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f467d6d3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780f95c0 con 0x7f46781a6be0 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f4675cc3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f467810cb40 0x7f46781a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f4676cc5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46781a6be0 0x7f46781a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:41.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f46764c4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f46780f5920 0x7f467810c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53978/0 (socket says 172.21.15.57:53978) 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f4675cc3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f467810cb40 0x7f46781a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43706/0 (socket says 172.21.15.57:43706) 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.808 7f4675cc3700 1 -- 172.21.15.57:0/62333345 learned_addr learned my addr 172.21.15.57:0/62333345 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f4676cc5700 1 -- 172.21.15.57:0/62333345 >> v2:172.21.15.57:3300/0 conn(0x7f467810cb40 msgr2=0x7f46781a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f4676cc5700 1 --2- 172.21.15.57:0/62333345 >> v2:172.21.15.57:3300/0 conn(0x7f467810cb40 0x7f46781a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f4676cc5700 1 -- 172.21.15.57:0/62333345 >> v1:172.21.15.57:6789/0 conn(0x7f46780f5920 legacy=0x7f467810c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f4676cc5700 1 -- 172.21.15.57:0/62333345 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46781aa680 con 0x7f46781a6be0 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f4675cc3700 1 --2- 172.21.15.57:0/62333345 >> v2:172.21.15.57:3300/0 conn(0x7f467810cb40 0x7f46781a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f4676cc5700 1 --2- 172.21.15.57:0/62333345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46781a6be0 0x7f46781a9040 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f46780f4640 tx=0x7f4670009cc0).ready entity=mon.1 client_cookie=aec320d9de39cd78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f46754c2700 1 -- 172.21.15.57:0/62333345 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46781aa680 con 0x7f46781a6be0 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f46754c2700 1 -- 172.21.15.57:0/62333345 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000b840 con 0x7f46781a6be0 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f46754c2700 1 -- 172.21.15.57:0/62333345 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f467000ba20 con 0x7f46781a6be0 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f467d6d3700 1 -- 172.21.15.57:0/62333345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46781a6be0 msgr2=0x7f46781a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:41.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.809 7f467d6d3700 1 --2- 172.21.15.57:0/62333345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46781a6be0 0x7f46781a9040 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f46780f4640 tx=0x7f4670009cc0).stop 2024-04-25T02:05:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.810 7f467d6d3700 1 -- 172.21.15.57:0/62333345 shutdown_connections 2024-04-25T02:05:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.810 7f467d6d3700 1 --2- 172.21.15.57:0/62333345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46781a6be0 0x7f46781a9040 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.810 7f467d6d3700 1 --2- 172.21.15.57:0/62333345 >> v2:172.21.15.57:3300/0 conn(0x7f467810cb40 0x7f46781a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.810 7f467d6d3700 1 -- 172.21.15.57:0/62333345 >> 172.21.15.57:0/62333345 conn(0x7f4678113a70 msgr2=0x7f46780f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.810 7f467d6d3700 1 -- 172.21.15.57:0/62333345 shutdown_connections 2024-04-25T02:05:41.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.810 7f467d6d3700 1 -- 172.21.15.57:0/62333345 wait complete. 2024-04-25T02:05:41.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f467d6d3700 1 Processor -- start 2024-04-25T02:05:41.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f467d6d3700 1 -- start start 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f467d6d3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46780d3810 0x7f46780d3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f467d6d3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f46780d4290 0x7f46781b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f467d6d3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46781b4ca0 0x7f46781b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f467d6d3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780f0110 con 0x7f46781b4ca0 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f467d6d3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780dd380 con 0x7f46780d3810 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f467d6d3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46780db3f0 con 0x7f46780d4290 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f46764c4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46780d3810 0x7f46780d3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f4676cc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46781b4ca0 0x7f46781b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f4675cc3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f46780d4290 0x7f46781b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f46764c4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46780d3810 0x7f46780d3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39406/0 (socket says 172.21.15.57:39406) 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f4676cc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46781b4ca0 0x7f46781b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43712/0 (socket says 172.21.15.57:43712) 2024-04-25T02:05:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f46764c4700 1 -- 172.21.15.57:0/1403905957 learned_addr learned my addr 172.21.15.57:0/1403905957 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.834 7f4675cc3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f46780d4290 0x7f46781b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37204/0 (socket says 172.21.15.57:37204) 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f46764c4700 1 -- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f46780d4290 msgr2=0x7f46781b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f46764c4700 1 --2- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f46780d4290 0x7f46781b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f46764c4700 1 -- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46781b4ca0 msgr2=0x7f46781b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f46764c4700 1 --2- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46781b4ca0 0x7f46781b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f46764c4700 1 -- 172.21.15.57:0/1403905957 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46780e02d0 con 0x7f46780d3810 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f4676cc5700 1 --2- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46781b4ca0 0x7f46781b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f46764c4700 1 --2- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46780d3810 0x7f46780d3c60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4668000bc0 tx=0x7f466800c7e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f466f7fe700 1 -- 172.21.15.57:0/1403905957 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f46780e02d0 con 0x7f46780d3810 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f466f7fe700 1 -- 172.21.15.57:0/1403905957 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46680072e0 con 0x7f46780d3810 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f466f7fe700 1 -- 172.21.15.57:0/1403905957 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4668005750 con 0x7f46780d3810 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46781bbd60 con 0x7f46780d3810 2024-04-25T02:05:41.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46781bc140 con 0x7f46780d3810 2024-04-25T02:05:41.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.835 7f466f7fe700 1 -- 172.21.15.57:0/1403905957 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4668005950 con 0x7f46780d3810 2024-04-25T02:05:41.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.836 7f466f7fe700 1 -- 172.21.15.57:0/1403905957 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f46680144d0 con 0x7f46780d3810 2024-04-25T02:05:41.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.836 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46780f08e0 con 0x7f46780d3810 2024-04-25T02:05:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.840 7f466f7fe700 1 -- 172.21.15.57:0/1403905957 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f46680070d0 con 0x7f46780d3810 2024-04-25T02:05:41.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.983 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46781aed90 con 0x7f46780d3810 2024-04-25T02:05:41.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.983 7f466f7fe700 1 -- 172.21.15.57:0/1403905957 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7f4668000c30 con 0x7f46780d3810 2024-04-25T02:05:41.989 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:41.989 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 >> v1:172.21.15.57:6816/43033 conn(0x7f465c0145b0 legacy=0x7f465c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46780d3810 msgr2=0x7f46780d3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 --2- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46780d3810 0x7f46780d3c60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4668000bc0 tx=0x7f466800c7e0).stop 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 shutdown_connections 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 --2- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46781b4ca0 0x7f46781b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 --2- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46780d3810 0x7f46780d3c60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 --2- 172.21.15.57:0/1403905957 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f46780d4290 0x7f46781b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 >> 172.21.15.57:0/1403905957 conn(0x7f46780c49a0 msgr2=0x7f46780d94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 shutdown_connections 2024-04-25T02:05:41.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:41.984 7f467d6d3700 1 -- 172.21.15.57:0/1403905957 wait complete. 2024-04-25T02:05:41.991 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 1 2024-04-25T02:05:44.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:05:44.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.141 7f350d8ad700 1 Processor -- start 2024-04-25T02:05:44.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.141 7f350d8ad700 1 -- start start 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.141 7f350d8ad700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f350810cb40 0x7f35081a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.141 7f350d8ad700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081a6be0 0x7f35081a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.141 7f350d8ad700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350810cf90 con 0x7f35080f5920 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.141 7f350d8ad700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35080fa290 con 0x7f35081a6be0 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.141 7f350d8ad700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35080f95c0 con 0x7f350810cb40 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f34fffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f350810cb40 0x7f35081a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3506dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081a6be0 0x7f35081a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f34fffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f350810cb40 0x7f35081a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37206/0 (socket says 172.21.15.57:37206) 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f34fffff700 1 -- 172.21.15.57:0/1027717478 learned_addr learned my addr 172.21.15.57:0/1027717478 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3505dc4700 1 -- 172.21.15.57:0/1027717478 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532927057 0 0) 0x7f34f8001110 con 0x7f35080f5920 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3505dc4700 1 -- 172.21.15.57:0/1027717478 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e8003270 con 0x7f35080f5920 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3506dc6700 1 -- 172.21.15.57:0/1027717478 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f350810cb40 msgr2=0x7f35081a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3506dc6700 1 --2- 172.21.15.57:0/1027717478 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f350810cb40 0x7f35081a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3506dc6700 1 -- 172.21.15.57:0/1027717478 >> v1:172.21.15.57:6789/0 conn(0x7f35080f5920 legacy=0x7f350810c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3506dc6700 1 -- 172.21.15.57:0/1027717478 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35081aa680 con 0x7f35081a6be0 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f34fffff700 1 --2- 172.21.15.57:0/1027717478 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f350810cb40 0x7f35081a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3506dc6700 1 --2- 172.21.15.57:0/1027717478 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081a6be0 0x7f35081a9040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f3508113400 tx=0x7f3500009d70).ready entity=mon.1 client_cookie=5ce51625948f3edf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3505dc4700 1 -- 172.21.15.57:0/1027717478 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f35081aa680 con 0x7f35081a6be0 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3505dc4700 1 -- 172.21.15.57:0/1027717478 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000b7c0 con 0x7f35081a6be0 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.142 7f3505dc4700 1 -- 172.21.15.57:0/1027717478 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f350000b9a0 con 0x7f35081a6be0 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.143 7f350d8ad700 1 -- 172.21.15.57:0/1027717478 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081a6be0 msgr2=0x7f35081a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.143 7f350d8ad700 1 --2- 172.21.15.57:0/1027717478 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081a6be0 0x7f35081a9040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f3508113400 tx=0x7f3500009d70).stop 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.143 7f350d8ad700 1 -- 172.21.15.57:0/1027717478 shutdown_connections 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.143 7f350d8ad700 1 --2- 172.21.15.57:0/1027717478 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081a6be0 0x7f35081a9040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.143 7f350d8ad700 1 --2- 172.21.15.57:0/1027717478 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f350810cb40 0x7f35081a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.143 7f350d8ad700 1 -- 172.21.15.57:0/1027717478 >> 172.21.15.57:0/1027717478 conn(0x7f3508113a70 msgr2=0x7f35080f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.143 7f350d8ad700 1 -- 172.21.15.57:0/1027717478 shutdown_connections 2024-04-25T02:05:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.143 7f350d8ad700 1 -- 172.21.15.57:0/1027717478 wait complete. 2024-04-25T02:05:44.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.167 7f350d8ad700 1 Processor -- start 2024-04-25T02:05:44.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.167 7f350d8ad700 1 -- start start 2024-04-25T02:05:44.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.167 7f350d8ad700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081adaa0 0x7f35081adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.167 7f350d8ad700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35081ae520 0x7f35081b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.167 7f350d8ad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35081b4b40 0x7f35081bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.167 7f350d8ad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080f0250 con 0x7f35081b4b40 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.167 7f350d8ad700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35080d4af0 con 0x7f35081adaa0 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.167 7f350d8ad700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35080c4a70 con 0x7f35081ae520 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35081ae520 0x7f35081b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f35065c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081adaa0 0x7f35081adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f3506dc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35081b4b40 0x7f35081bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35081ae520 0x7f35081b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37220/0 (socket says 172.21.15.57:37220) 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f35065c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081adaa0 0x7f35081adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39422/0 (socket says 172.21.15.57:39422) 2024-04-25T02:05:44.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 -- 172.21.15.57:0/621071764 learned_addr learned my addr 172.21.15.57:0/621071764 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f3506dc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35081b4b40 0x7f35081bbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43724/0 (socket says 172.21.15.57:43724) 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 -- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081adaa0 msgr2=0x7f35081adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 --2- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081adaa0 0x7f35081adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 -- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35081b4b40 msgr2=0x7f35081bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 --2- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35081b4b40 0x7f35081bbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 -- 172.21.15.57:0/621071764 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080d5650 con 0x7f35081ae520 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34fffff700 1 --2- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35081ae520 0x7f35081b4510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f35080c5650 tx=0x7f34f000ecb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34ff7fe700 1 -- 172.21.15.57:0/621071764 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f35080d5650 con 0x7f35081ae520 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34ff7fe700 1 -- 172.21.15.57:0/621071764 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f000c620 con 0x7f35081ae520 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f350d8ad700 1 -- 172.21.15.57:0/621071764 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35081b4f90 con 0x7f35081ae520 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f34ff7fe700 1 -- 172.21.15.57:0/621071764 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f34f000f040 con 0x7f35081ae520 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.168 7f350d8ad700 1 -- 172.21.15.57:0/621071764 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35081bc230 con 0x7f35081ae520 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.169 7f34ff7fe700 1 -- 172.21.15.57:0/621071764 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f34f0022060 con 0x7f35081ae520 2024-04-25T02:05:44.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.169 7f34ff7fe700 1 -- 172.21.15.57:0/621071764 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f34f0010040 con 0x7f35081ae520 2024-04-25T02:05:44.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.169 7f350d8ad700 1 -- 172.21.15.57:0/621071764 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35080f08e0 con 0x7f35081ae520 2024-04-25T02:05:44.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.173 7f34ff7fe700 1 -- 172.21.15.57:0/621071764 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f34f000edf0 con 0x7f35081ae520 2024-04-25T02:05:44.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.316 7f350d8ad700 1 -- 172.21.15.57:0/621071764 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35081aec30 con 0x7f35081ae520 2024-04-25T02:05:44.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.316 7f34ff7fe700 1 -- 172.21.15.57:0/621071764 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+778 (secure 0 0 0) 0x7f34f0000c30 con 0x7f35081ae520 2024-04-25T02:05:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:44.322 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":2}],"filesystems":[]} 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 -- 172.21.15.57:0/621071764 >> v1:172.21.15.57:6816/43033 conn(0x7f34ec0145b0 legacy=0x7f34ec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 -- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35081ae520 msgr2=0x7f35081b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 --2- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35081ae520 0x7f35081b4510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f35080c5650 tx=0x7f34f000ecb0).stop 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 -- 172.21.15.57:0/621071764 shutdown_connections 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 --2- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35081b4b40 0x7f35081bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 --2- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35081adaa0 0x7f35081adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 --2- 172.21.15.57:0/621071764 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35081ae520 0x7f35081b4510 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 -- 172.21.15.57:0/621071764 >> 172.21.15.57:0/621071764 conn(0x7f35080c59b0 msgr2=0x7f35080d6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 -- 172.21.15.57:0/621071764 shutdown_connections 2024-04-25T02:05:44.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.318 7f350d8ad700 1 -- 172.21.15.57:0/621071764 wait complete. 2024-04-25T02:05:44.325 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2024-04-25T02:05:44.334 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:44.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f045511f700 1 Processor -- start 2024-04-25T02:05:44.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f045511f700 1 -- start start 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f045511f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500f5920 0x7f04500f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f045511f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04500f1ec0 0x7f045010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f045511f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04500f2310 0x7f045010e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f045511f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04500f9230 con 0x7f04500f1ec0 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f045511f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045010ef10 con 0x7f04500f5920 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f045511f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04501aa660 con 0x7f04500f2310 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f044ddfc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500f5920 0x7f04500f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f044d5fb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04500f1ec0 0x7f045010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f044e5fd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04500f2310 0x7f045010e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f044ddfc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500f5920 0x7f04500f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39434/0 (socket says 172.21.15.57:39434) 2024-04-25T02:05:44.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f044d5fb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04500f1ec0 0x7f045010e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43736/0 (socket says 172.21.15.57:43736) 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f044ddfc700 1 -- 172.21.15.57:0/3046036243 learned_addr learned my addr 172.21.15.57:0/3046036243 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.460 7f044e5fd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04500f2310 0x7f045010e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37232/0 (socket says 172.21.15.57:37232) 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044e5fd700 1 -- 172.21.15.57:0/3046036243 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500f5920 msgr2=0x7f04500f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044e5fd700 1 --2- 172.21.15.57:0/3046036243 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500f5920 0x7f04500f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044e5fd700 1 -- 172.21.15.57:0/3046036243 >> v2:172.21.15.57:3300/0 conn(0x7f04500f1ec0 msgr2=0x7f045010e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044e5fd700 1 --2- 172.21.15.57:0/3046036243 >> v2:172.21.15.57:3300/0 conn(0x7f04500f1ec0 0x7f045010e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044e5fd700 1 -- 172.21.15.57:0/3046036243 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04501aa810 con 0x7f04500f2310 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044ddfc700 1 --2- 172.21.15.57:0/3046036243 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500f5920 0x7f04500f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044d5fb700 1 --2- 172.21.15.57:0/3046036243 >> v2:172.21.15.57:3300/0 conn(0x7f04500f1ec0 0x7f045010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044e5fd700 1 --2- 172.21.15.57:0/3046036243 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04500f2310 0x7f045010e8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f04480032f0 tx=0x7f0448009c90).ready entity=mon.2 client_cookie=c23909f1d496cc05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044cdfa700 1 -- 172.21.15.57:0/3046036243 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f04501aa810 con 0x7f04500f2310 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044cdfa700 1 -- 172.21.15.57:0/3046036243 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044800b880 con 0x7f04500f2310 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f044cdfa700 1 -- 172.21.15.57:0/3046036243 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f044800ba60 con 0x7f04500f2310 2024-04-25T02:05:44.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f045511f700 1 -- 172.21.15.57:0/3046036243 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04500f2310 msgr2=0x7f045010e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.461 7f045511f700 1 --2- 172.21.15.57:0/3046036243 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04500f2310 0x7f045010e8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f04480032f0 tx=0x7f0448009c90).stop 2024-04-25T02:05:44.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.462 7f045511f700 1 -- 172.21.15.57:0/3046036243 shutdown_connections 2024-04-25T02:05:44.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.462 7f045511f700 1 --2- 172.21.15.57:0/3046036243 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04500f2310 0x7f045010e8e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.462 7f045511f700 1 --2- 172.21.15.57:0/3046036243 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500f5920 0x7f04500f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.462 7f045511f700 1 --2- 172.21.15.57:0/3046036243 >> v2:172.21.15.57:3300/0 conn(0x7f04500f1ec0 0x7f045010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.462 7f045511f700 1 -- 172.21.15.57:0/3046036243 >> 172.21.15.57:0/3046036243 conn(0x7f0450113a70 msgr2=0x7f04500f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:44.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.462 7f045511f700 1 -- 172.21.15.57:0/3046036243 shutdown_connections 2024-04-25T02:05:44.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.462 7f045511f700 1 -- 172.21.15.57:0/3046036243 wait complete. 2024-04-25T02:05:44.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f045511f700 1 Processor -- start 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f045511f700 1 -- start start 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f045511f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04500df600 0x7f04500dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f045511f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500e0080 0x7f04501b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f045511f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04501b4ee0 0x7f04501b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f045511f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04500f0250 con 0x7f04500df600 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f045511f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04500c4f40 con 0x7f04500e0080 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f045511f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04500be970 con 0x7f04501b4ee0 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044ddfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04500df600 0x7f04500dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044d5fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500e0080 0x7f04501b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044e5fd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04501b4ee0 0x7f04501b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044ddfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04500df600 0x7f04500dfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43744/0 (socket says 172.21.15.57:43744) 2024-04-25T02:05:44.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044d5fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500e0080 0x7f04501b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39436/0 (socket says 172.21.15.57:39436) 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044ddfc700 1 -- 172.21.15.57:0/1165971005 learned_addr learned my addr 172.21.15.57:0/1165971005 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044e5fd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04501b4ee0 0x7f04501b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37234/0 (socket says 172.21.15.57:37234) 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044e5fd700 1 -- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500e0080 msgr2=0x7f04501b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044e5fd700 1 --2- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500e0080 0x7f04501b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044e5fd700 1 -- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04500df600 msgr2=0x7f04500dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044e5fd700 1 --2- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04500df600 0x7f04500dfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.486 7f044e5fd700 1 -- 172.21.15.57:0/1165971005 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04500e0bb0 con 0x7f04501b4ee0 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f044ddfc700 1 --2- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04500df600 0x7f04500dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f044e5fd700 1 --2- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04501b4ee0 0x7f04501b5330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f04500e1020 tx=0x7f0448006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f043effd700 1 -- 172.21.15.57:0/1165971005 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f04500e0bb0 con 0x7f04501b4ee0 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f043effd700 1 -- 172.21.15.57:0/1165971005 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448011940 con 0x7f04501b4ee0 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f045511f700 1 -- 172.21.15.57:0/1165971005 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04500cf610 con 0x7f04501b4ee0 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f043effd700 1 -- 172.21.15.57:0/1165971005 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0448017040 con 0x7f04501b4ee0 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f045511f700 1 -- 172.21.15.57:0/1165971005 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04501bc080 con 0x7f04501b4ee0 2024-04-25T02:05:44.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f043effd700 1 -- 172.21.15.57:0/1165971005 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0448011d10 con 0x7f04501b4ee0 2024-04-25T02:05:44.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.487 7f043effd700 1 -- 172.21.15.57:0/1165971005 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f0448018030 con 0x7f04501b4ee0 2024-04-25T02:05:44.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.488 7f045511f700 1 -- 172.21.15.57:0/1165971005 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04500f08e0 con 0x7f04501b4ee0 2024-04-25T02:05:44.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.491 7f043effd700 1 -- 172.21.15.57:0/1165971005 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f044800b670 con 0x7f04501b4ee0 2024-04-25T02:05:44.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.602 7f045511f700 1 -- 172.21.15.57:0/1165971005 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04500c4c40 con 0x7f04501b4ee0 2024-04-25T02:05:44.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.603 7f043effd700 1 -- 172.21.15.57:0/1165971005 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+5872 (secure 0 0 0) 0x7f0448011730 con 0x7f04501b4ee0 2024-04-25T02:05:44.609 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:44.609 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":12,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:39.733707","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:44.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 -- 172.21.15.57:0/1165971005 >> v1:172.21.15.57:6816/43033 conn(0x7f042c0145b0 legacy=0x7f042c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 -- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04501b4ee0 msgr2=0x7f04501b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 --2- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04501b4ee0 0x7f04501b5330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f04500e1020 tx=0x7f0448006c40).stop 2024-04-25T02:05:44.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 -- 172.21.15.57:0/1165971005 shutdown_connections 2024-04-25T02:05:44.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 --2- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04501b4ee0 0x7f04501b5330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 --2- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04500df600 0x7f04500dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 --2- 172.21.15.57:0/1165971005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04500e0080 0x7f04501b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 -- 172.21.15.57:0/1165971005 >> 172.21.15.57:0/1165971005 conn(0x7f04500c5c80 msgr2=0x7f04500d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:44.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 -- 172.21.15.57:0/1165971005 shutdown_connections 2024-04-25T02:05:44.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.604 7f045511f700 1 -- 172.21.15.57:0/1165971005 wait complete. 2024-04-25T02:05:44.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-25T02:05:44.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.750 7f93be351700 1 Processor -- start 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.750 7f93be351700 1 -- start start 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93be351700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b80f5a10 0x7f93b810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93be351700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b810b740 0x7f93b819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93be351700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b81a0a70 con 0x7f93b810bb90 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93be351700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80fa590 con 0x7f93b810b740 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93be351700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93b81a0c90 con 0x7f93b80f5a10 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b7086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b80f5a10 0x7f93b810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b7086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b80f5a10 0x7f93b810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37244/0 (socket says 172.21.15.57:37244) 2024-04-25T02:05:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b7086700 1 -- 172.21.15.57:0/3601935297 learned_addr learned my addr 172.21.15.57:0/3601935297 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b6885700 1 --2- 172.21.15.57:0/3601935297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b810b740 0x7f93b819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b6084700 1 -- 172.21.15.57:0/3601935297 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505997511 0 0) 0x7f93b0001490 con 0x7f93b810bb90 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b7086700 1 -- 172.21.15.57:0/3601935297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b810b740 msgr2=0x7f93b819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b7086700 1 --2- 172.21.15.57:0/3601935297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b810b740 0x7f93b819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b7086700 1 -- 172.21.15.57:0/3601935297 >> v1:172.21.15.57:6789/0 conn(0x7f93b810bb90 legacy=0x7f93b81a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b7086700 1 -- 172.21.15.57:0/3601935297 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b81a93d0 con 0x7f93b80f5a10 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b7086700 1 --2- 172.21.15.57:0/3601935297 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b80f5a10 0x7f93b810b110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f93b810f920 tx=0x7f93a800bc60).ready entity=mon.2 client_cookie=d19588829a17a4b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b6084700 1 -- 172.21.15.57:0/3601935297 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93b81a93d0 con 0x7f93b80f5a10 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b6084700 1 -- 172.21.15.57:0/3601935297 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800dc40 con 0x7f93b80f5a10 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93b6084700 1 -- 172.21.15.57:0/3601935297 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93a8010660 con 0x7f93b80f5a10 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93be351700 1 -- 172.21.15.57:0/3601935297 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b80f5a10 msgr2=0x7f93b810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.751 7f93be351700 1 --2- 172.21.15.57:0/3601935297 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b80f5a10 0x7f93b810b110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f93b810f920 tx=0x7f93a800bc60).stop 2024-04-25T02:05:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.752 7f93be351700 1 -- 172.21.15.57:0/3601935297 shutdown_connections 2024-04-25T02:05:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.752 7f93be351700 1 --2- 172.21.15.57:0/3601935297 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b80f5a10 0x7f93b810b110 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.752 7f93be351700 1 --2- 172.21.15.57:0/3601935297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b810b740 0x7f93b819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.752 7f93be351700 1 -- 172.21.15.57:0/3601935297 >> 172.21.15.57:0/3601935297 conn(0x7f93b8113a70 msgr2=0x7f93b80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.752 7f93be351700 1 -- 172.21.15.57:0/3601935297 shutdown_connections 2024-04-25T02:05:44.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.752 7f93be351700 1 -- 172.21.15.57:0/3601935297 wait complete. 2024-04-25T02:05:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93be351700 1 Processor -- start 2024-04-25T02:05:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93be351700 1 -- start start 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93be351700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b81aadc0 0x7f93b81ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93be351700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b81a1240 0x7f93b81a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93be351700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b81a1cc0 0x7f93b81a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93be351700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80c3f90 con 0x7f93b81a1240 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93be351700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80caf60 con 0x7f93b81aadc0 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93be351700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93b81a2740 con 0x7f93b81a1cc0 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93b7086700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b81aadc0 0x7f93b81ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93b6885700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b81a1240 0x7f93b81a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93b7086700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b81aadc0 0x7f93b81ab210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39442/0 (socket says 172.21.15.57:39442) 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93b7086700 1 -- 172.21.15.57:0/127333934 learned_addr learned my addr 172.21.15.57:0/127333934 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.776 7f93b7887700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b81a1cc0 0x7f93b81a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b6885700 1 -- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b81a1cc0 msgr2=0x7f93b81a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b6885700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b81a1cc0 0x7f93b81a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b6885700 1 -- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b81aadc0 msgr2=0x7f93b81ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b6885700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b81aadc0 0x7f93b81ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b6885700 1 -- 172.21.15.57:0/127333934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b81bbf60 con 0x7f93b81a1240 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b7086700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b81aadc0 0x7f93b81ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b6885700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b81a1240 0x7f93b81a1690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f93a000c000 tx=0x7f93a000ec40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b4881700 1 -- 172.21.15.57:0/127333934 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93b81bbf60 con 0x7f93b81a1240 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b4881700 1 -- 172.21.15.57:0/127333934 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000c9a0 con 0x7f93b81a1240 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93b4881700 1 -- 172.21.15.57:0/127333934 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93a000f040 con 0x7f93b81a1240 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93be351700 1 -- 172.21.15.57:0/127333934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b81bc160 con 0x7f93b81a1240 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.777 7f93be351700 1 -- 172.21.15.57:0/127333934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b81bc540 con 0x7f93b81a1240 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.778 7f93b4881700 1 -- 172.21.15.57:0/127333934 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f93a0011070 con 0x7f93b81a1240 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.778 7f93b4881700 1 -- 172.21.15.57:0/127333934 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f93a0010040 con 0x7f93b81a1240 2024-04-25T02:05:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.778 7f93be351700 1 -- 172.21.15.57:0/127333934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b80f08e0 con 0x7f93b81a1240 2024-04-25T02:05:44.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.781 7f93b4881700 1 -- 172.21.15.57:0/127333934 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f93a000c5a0 con 0x7f93b81a1240 2024-04-25T02:05:44.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.891 7f93be351700 1 -- 172.21.15.57:0/127333934 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f93b80e2430 con 0x7f93b81a1240 2024-04-25T02:05:44.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.891 7f93b4881700 1 -- 172.21.15.57:0/127333934 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93a0000c30 con 0x7f93b81a1240 2024-04-25T02:05:44.897 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:05:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 -- 172.21.15.57:0/127333934 >> v1:172.21.15.57:6816/43033 conn(0x7f939c0145b0 legacy=0x7f939c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 -- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b81a1240 msgr2=0x7f93b81a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b81a1240 0x7f93b81a1690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f93a000c000 tx=0x7f93a000ec40).stop 2024-04-25T02:05:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 -- 172.21.15.57:0/127333934 shutdown_connections 2024-04-25T02:05:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93b81a1cc0 0x7f93b81a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93b81aadc0 0x7f93b81ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 --2- 172.21.15.57:0/127333934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b81a1240 0x7f93b81a1690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:44.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 -- 172.21.15.57:0/127333934 >> 172.21.15.57:0/127333934 conn(0x7f93b81a3bf0 msgr2=0x7f93b80d6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:44.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 -- 172.21.15.57:0/127333934 shutdown_connections 2024-04-25T02:05:44.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:44.892 7f93be351700 1 -- 172.21.15.57:0/127333934 wait complete. 2024-04-25T02:05:44.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:05:45.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.035 7fd7005a1700 1 Processor -- start 2024-04-25T02:05:45.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.035 7fd7005a1700 1 -- start start 2024-04-25T02:05:45.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd7005a1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f810b890 0x7fd6f81a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd7005a1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f81a5950 0x7fd6f81a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd7005a1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f810bce0 con 0x7fd6f80f5990 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd7005a1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80fa510 con 0x7fd6f810b890 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd7005a1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f81a0bd0 con 0x7fd6f81a5950 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd6fcb9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f810b890 0x7fd6f81a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd6fdb9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f81a5950 0x7fd6f81a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd6fd39c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd6f80f5990 0x7fd6f810b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54006/0 (socket says 172.21.15.57:54006) 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd6fd39c700 1 -- 172.21.15.57:0/388218731 learned_addr learned my addr 172.21.15.57:0/388218731 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd6e7fff700 1 -- 172.21.15.57:0/388218731 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876946049 0 0) 0x7fd6f4001110 con 0x7fd6f80f5990 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd6e7fff700 1 -- 172.21.15.57:0/388218731 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e0003270 con 0x7fd6f80f5990 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd6fcb9b700 1 -- 172.21.15.57:0/388218731 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f81a5950 msgr2=0x7fd6f81a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.036 7fd6fcb9b700 1 --2- 172.21.15.57:0/388218731 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f81a5950 0x7fd6f81a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd6fcb9b700 1 -- 172.21.15.57:0/388218731 >> v1:172.21.15.57:6789/0 conn(0x7fd6f80f5990 legacy=0x7fd6f810b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd6fcb9b700 1 -- 172.21.15.57:0/388218731 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80f1810 con 0x7fd6f810b890 2024-04-25T02:05:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd6fdb9d700 1 --2- 172.21.15.57:0/388218731 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f81a5950 0x7fd6f81a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd6fcb9b700 1 --2- 172.21.15.57:0/388218731 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f810b890 0x7fd6f81a5320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd6f8103990 tx=0x7fd6e800ba50).ready entity=mon.1 client_cookie=b4eae54e7f403af5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd6e7fff700 1 -- 172.21.15.57:0/388218731 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd6f80f1810 con 0x7fd6f810b890 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd6e7fff700 1 -- 172.21.15.57:0/388218731 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800d570 con 0x7fd6f810b890 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd6e7fff700 1 -- 172.21.15.57:0/388218731 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd6e800d940 con 0x7fd6f810b890 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd7005a1700 1 -- 172.21.15.57:0/388218731 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f810b890 msgr2=0x7fd6f81a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd7005a1700 1 --2- 172.21.15.57:0/388218731 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f810b890 0x7fd6f81a5320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd6f8103990 tx=0x7fd6e800ba50).stop 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd7005a1700 1 -- 172.21.15.57:0/388218731 shutdown_connections 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd7005a1700 1 --2- 172.21.15.57:0/388218731 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f81a5950 0x7fd6f81a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd7005a1700 1 --2- 172.21.15.57:0/388218731 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f810b890 0x7fd6f81a5320 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.037 7fd7005a1700 1 -- 172.21.15.57:0/388218731 >> 172.21.15.57:0/388218731 conn(0x7fd6f81139f0 msgr2=0x7fd6f80f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.038 7fd7005a1700 1 -- 172.21.15.57:0/388218731 shutdown_connections 2024-04-25T02:05:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.038 7fd7005a1700 1 -- 172.21.15.57:0/388218731 wait complete. 2024-04-25T02:05:45.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd7005a1700 1 Processor -- start 2024-04-25T02:05:45.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd7005a1700 1 -- start start 2024-04-25T02:05:45.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd7005a1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f80cf7f0 0x7fd6f80cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd7005a1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f80d0270 0x7fd6f81b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd7005a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6f81b49a0 0x7fd6f81b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd7005a1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80a82d0 con 0x7fd6f81b49a0 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd7005a1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80c4620 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd7005a1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80c4200 con 0x7fd6f80d0270 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd6fcb9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f80d0270 0x7fd6f81b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd6fdb9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6f81b49a0 0x7fd6f81b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd6fd39c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f80cf7f0 0x7fd6f80cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd6fdb9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6f81b49a0 0x7fd6f81b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43750/0 (socket says 172.21.15.57:43750) 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd6fcb9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f80d0270 0x7fd6f81b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37264/0 (socket says 172.21.15.57:37264) 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.062 7fd6fdb9d700 1 -- 172.21.15.57:0/3358227661 learned_addr learned my addr 172.21.15.57:0/3358227661 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6fd39c700 1 -- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f80d0270 msgr2=0x7fd6f81b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6fd39c700 1 --2- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f80d0270 0x7fd6f81b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6fd39c700 1 -- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6f81b49a0 msgr2=0x7fd6f81b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6fd39c700 1 --2- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6f81b49a0 0x7fd6f81b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6fd39c700 1 -- 172.21.15.57:0/3358227661 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80e07c0 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6fd39c700 1 --2- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f80cf7f0 0x7fd6f80cfc40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd6f80bb1f0 tx=0x7fd6f400c810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6e67fc700 1 -- 172.21.15.57:0/3358227661 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd6f80e07c0 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6e67fc700 1 -- 172.21.15.57:0/3358227661 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f40070d0 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f81bbae0 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6e67fc700 1 -- 172.21.15.57:0/3358227661 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd6f4005620 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f81bbec0 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.063 7fd6e67fc700 1 -- 172.21.15.57:0/3358227661 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd6f4005820 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.064 7fd6e67fc700 1 -- 172.21.15.57:0/3358227661 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fd6f4012d70 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.064 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f80f0860 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.068 7fd6e67fc700 1 -- 172.21.15.57:0/3358227661 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd6f401d510 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.181 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd6f81aeab0 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.181 7fd6e67fc700 1 -- 172.21.15.57:0/3358227661 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+64 (secure 0 0 0) 0x7fd6f80fef40 con 0x7fd6f80cf7f0 2024-04-25T02:05:45.187 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:45.187 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2024-04-25T02:05:45.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:05:45.187 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2024-04-25T02:05:45.187 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2024-04-25T02:05:45.187 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:05:45.187 INFO:teuthology.orchestra.run.smithi057.stdout:] 2024-04-25T02:05:45.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 >> v1:172.21.15.57:6816/43033 conn(0x7fd6d80145b0 legacy=0x7fd6d8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f80cf7f0 msgr2=0x7fd6f80cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 --2- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f80cf7f0 0x7fd6f80cfc40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd6f80bb1f0 tx=0x7fd6f400c810).stop 2024-04-25T02:05:45.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 shutdown_connections 2024-04-25T02:05:45.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 --2- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6f81b49a0 0x7fd6f81b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 --2- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6f80cf7f0 0x7fd6f80cfc40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 --2- 172.21.15.57:0/3358227661 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd6f80d0270 0x7fd6f81b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 >> 172.21.15.57:0/3358227661 conn(0x7fd6f80db5a0 msgr2=0x7fd6f80b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:45.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 shutdown_connections 2024-04-25T02:05:45.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.182 7fd7005a1700 1 -- 172.21.15.57:0/3358227661 wait complete. 2024-04-25T02:05:45.199 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:05:45.199 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:05:45.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.328 7f586895b700 1 Processor -- start 2024-04-25T02:05:45.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.328 7f586895b700 1 -- start start 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f586895b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640f5a00 0x7f586410b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f586895b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f586410bb80 0x7f58641a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f586895b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58641a0a60 con 0x7f586410b730 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f586895b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58640fa580 con 0x7f58640f5a00 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f586895b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58641a0c80 con 0x7f586410bb80 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f58615fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640f5a00 0x7f586410b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f58615fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640f5a00 0x7f586410b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39462/0 (socket says 172.21.15.57:39462) 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f58615fb700 1 -- 172.21.15.57:0/3142180909 learned_addr learned my addr 172.21.15.57:0/3142180909 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5860dfa700 1 --1- 172.21.15.57:0/3142180909 >> v1:172.21.15.57:6789/0 conn(0x7f586410b730 0x7f586419fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54014/0 (socket says 172.21.15.57:54014) 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5861dfc700 1 --2- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f586410bb80 0x7f58641a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5861dfc700 1 -- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640f5a00 msgr2=0x7f586410b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5861dfc700 1 --2- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640f5a00 0x7f586410b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5861dfc700 1 -- 172.21.15.57:0/3142180909 >> v1:172.21.15.57:6789/0 conn(0x7f586410b730 legacy=0x7f586419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5853fff700 1 -- 172.21.15.57:0/3142180909 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163901305 0 0) 0x7f5854001110 con 0x7f586410b730 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5861dfc700 1 -- 172.21.15.57:0/3142180909 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58641a93c0 con 0x7f586410bb80 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f58615fb700 1 --2- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640f5a00 0x7f586410b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5861dfc700 1 --2- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f586410bb80 0x7f58641a0430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f58640f47b0 tx=0x7f585c009cf0).ready entity=mon.2 client_cookie=7c6a338a4f148d66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5853fff700 1 -- 172.21.15.57:0/3142180909 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58641a93c0 con 0x7f586410bb80 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5853fff700 1 -- 172.21.15.57:0/3142180909 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c00b840 con 0x7f586410bb80 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f5853fff700 1 -- 172.21.15.57:0/3142180909 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f585c00ba20 con 0x7f586410bb80 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f586895b700 1 -- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f586410bb80 msgr2=0x7f58641a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.329 7f586895b700 1 --2- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f586410bb80 0x7f58641a0430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f58640f47b0 tx=0x7f585c009cf0).stop 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.330 7f586895b700 1 -- 172.21.15.57:0/3142180909 shutdown_connections 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.330 7f586895b700 1 --2- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f586410bb80 0x7f58641a0430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.330 7f586895b700 1 --2- 172.21.15.57:0/3142180909 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640f5a00 0x7f586410b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.330 7f586895b700 1 -- 172.21.15.57:0/3142180909 >> 172.21.15.57:0/3142180909 conn(0x7f5864113a60 msgr2=0x7f58640f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.330 7f586895b700 1 -- 172.21.15.57:0/3142180909 shutdown_connections 2024-04-25T02:05:45.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.330 7f586895b700 1 -- 172.21.15.57:0/3142180909 wait complete. 2024-04-25T02:05:45.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f586895b700 1 Processor -- start 2024-04-25T02:05:45.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f586895b700 1 -- start start 2024-04-25T02:05:45.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f586895b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58640d7370 0x7f58640ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f586895b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640cea20 0x7f58641b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f586895b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58640cee70 0x7f58641b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f586895b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58640dd2a0 con 0x7f58640d7370 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f586895b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58641b10d0 con 0x7f58640cea20 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f586895b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58641b1300 con 0x7f58640cee70 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.354 7f58615fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58640d7370 0x7f58640ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58615fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58640d7370 0x7f58640ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43756/0 (socket says 172.21.15.57:43756) 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58615fb700 1 -- 172.21.15.57:0/3055653145 learned_addr learned my addr 172.21.15.57:0/3055653145 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f5860dfa700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640cea20 0x7f58641b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f5861dfc700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58640cee70 0x7f58641b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58615fb700 1 -- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58640cee70 msgr2=0x7f58641b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58615fb700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58640cee70 0x7f58641b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58615fb700 1 -- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640cea20 msgr2=0x7f58641b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58615fb700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640cea20 0x7f58641b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58615fb700 1 -- 172.21.15.57:0/3055653145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58641b7b60 con 0x7f58640d7370 2024-04-25T02:05:45.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f5860dfa700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640cea20 0x7f58641b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58615fb700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58640d7370 0x7f58640ce3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f58580067f0 tx=0x7f585800e640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58527fc700 1 -- 172.21.15.57:0/3055653145 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58641b7b60 con 0x7f58640d7370 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58527fc700 1 -- 172.21.15.57:0/3055653145 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585801a470 con 0x7f58640d7370 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f586895b700 1 -- 172.21.15.57:0/3055653145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58641b7d60 con 0x7f58640d7370 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f58527fc700 1 -- 172.21.15.57:0/3055653145 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f585801a840 con 0x7f58640d7370 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.355 7f586895b700 1 -- 172.21.15.57:0/3055653145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58641b8140 con 0x7f58640d7370 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.356 7f58527fc700 1 -- 172.21.15.57:0/3055653145 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5858022070 con 0x7f58640d7370 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.356 7f58527fc700 1 -- 172.21.15.57:0/3055653145 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f585801cab0 con 0x7f58640d7370 2024-04-25T02:05:45.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.356 7f586895b700 1 -- 172.21.15.57:0/3055653145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58640f08d0 con 0x7f58640d7370 2024-04-25T02:05:45.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.360 7f58527fc700 1 -- 172.21.15.57:0/3055653145 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f585800ebd0 con 0x7f58640d7370 2024-04-25T02:05:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 -- 172.21.15.57:0/3055653145 >> v1:172.21.15.57:6816/43033 conn(0x7f58480145b0 legacy=0x7f5848016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 -- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58640d7370 msgr2=0x7f58640ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58640d7370 0x7f58640ce3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f58580067f0 tx=0x7f585800e640).stop 2024-04-25T02:05:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 -- 172.21.15.57:0/3055653145 shutdown_connections 2024-04-25T02:05:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58640cee70 0x7f58641b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58640d7370 0x7f58640ce3f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 --2- 172.21.15.57:0/3055653145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58640cea20 0x7f58641b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 -- 172.21.15.57:0/3055653145 >> 172.21.15.57:0/3055653145 conn(0x7f58640c4ae0 msgr2=0x7f58641a4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 -- 172.21.15.57:0/3055653145 shutdown_connections 2024-04-25T02:05:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.472 7f586895b700 1 -- 172.21.15.57:0/3055653145 wait complete. 2024-04-25T02:05:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:Invalid command: missing required parameter pg_num() 2024-04-25T02:05:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool create {} {replicated|erasure} {} {} {} {} {} {} {} : create pool 2024-04-25T02:05:45.479 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: invalid command 2024-04-25T02:05:45.490 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T02:05:45.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 2024-04-25T02:05:45.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.619 7fb5b2c72700 1 Processor -- start 2024-04-25T02:05:45.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.619 7fb5b2c72700 1 -- start start 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5b2c72700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5ac0f5a10 0x7fb5ac10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5b2c72700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac10b740 0x7fb5ac19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5b2c72700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac10bb90 0x7fb5ac1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5b2c72700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac0fa590 con 0x7fb5ac0f5a10 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5b2c72700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1a08a0 con 0x7fb5ac10b740 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5b2c72700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1a0ad0 con 0x7fb5ac10bb90 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5a2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac10b740 0x7fb5ac19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5abfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac10bb90 0x7fb5ac1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5ab7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5ac0f5a10 0x7fb5ac10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5a2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac10b740 0x7fb5ac19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39490/0 (socket says 172.21.15.57:39490) 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5ab7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5ac0f5a10 0x7fb5ac10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43762/0 (socket says 172.21.15.57:43762) 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5a2ffd700 1 -- 172.21.15.57:0/562715349 learned_addr learned my addr 172.21.15.57:0/562715349 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5abfff700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac10bb90 0x7fb5ac1a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37288/0 (socket says 172.21.15.57:37288) 2024-04-25T02:05:45.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5ab7fe700 1 -- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac10bb90 msgr2=0x7fb5ac1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5ab7fe700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac10bb90 0x7fb5ac1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5ab7fe700 1 -- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac10b740 msgr2=0x7fb5ac19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5ab7fe700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac10b740 0x7fb5ac19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5ab7fe700 1 -- 172.21.15.57:0/562715349 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac1a73b0 con 0x7fb5ac0f5a10 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.620 7fb5abfff700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac10bb90 0x7fb5ac1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5ab7fe700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0f5a10 0x7fb5ac10b110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb59c002f70 tx=0x7fb59c00b9f0).ready entity=mon.0 client_cookie=d392482f033c5418 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5aaffd700 1 -- 172.21.15.57:0/562715349 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5ac1a73b0 con 0x7fb5ac0f5a10 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5aaffd700 1 -- 172.21.15.57:0/562715349 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c00d570 con 0x7fb5ac0f5a10 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5aaffd700 1 -- 172.21.15.57:0/562715349 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb59c00d940 con 0x7fb5ac0f5a10 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 -- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0f5a10 msgr2=0x7fb5ac10b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0f5a10 0x7fb5ac10b110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb59c002f70 tx=0x7fb59c00b9f0).stop 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 -- 172.21.15.57:0/562715349 shutdown_connections 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac10bb90 0x7fb5ac1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0f5a10 0x7fb5ac10b110 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 --2- 172.21.15.57:0/562715349 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac10b740 0x7fb5ac19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 -- 172.21.15.57:0/562715349 >> 172.21.15.57:0/562715349 conn(0x7fb5ac113a70 msgr2=0x7fb5ac0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:45.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 -- 172.21.15.57:0/562715349 shutdown_connections 2024-04-25T02:05:45.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.621 7fb5b2c72700 1 -- 172.21.15.57:0/562715349 wait complete. 2024-04-25T02:05:45.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.645 7fb5b2c72700 1 Processor -- start 2024-04-25T02:05:45.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.645 7fb5b2c72700 1 -- start start 2024-04-25T02:05:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5b2c72700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac0d80e0 0x7fb5ac0d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5b2c72700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0d0f00 0x7fb5ac1b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5b2c72700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac0d1350 0x7fb5ac1b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5b2c72700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0c1610 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5b2c72700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0d8530 con 0x7fb5ac0d1350 2024-04-25T02:05:45.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5b2c72700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1b4d30 con 0x7fb5ac0d80e0 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5a2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0d0f00 0x7fb5ac1b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5abfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac0d1350 0x7fb5ac1b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5a2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0d0f00 0x7fb5ac1b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43766/0 (socket says 172.21.15.57:43766) 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5a2ffd700 1 -- 172.21.15.57:0/62668621 learned_addr learned my addr 172.21.15.57:0/62668621 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5ab7fe700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac0d80e0 0x7fb5ac0d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5a2ffd700 1 -- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac0d80e0 msgr2=0x7fb5ac0d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5a2ffd700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac0d80e0 0x7fb5ac0d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5a2ffd700 1 -- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac0d1350 msgr2=0x7fb5ac1b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5a2ffd700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac0d1350 0x7fb5ac1b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5a2ffd700 1 -- 172.21.15.57:0/62668621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac1b4f60 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.646 7fb5abfff700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac0d1350 0x7fb5ac1b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.647 7fb5a2ffd700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0d0f00 0x7fb5ac1b40d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb594006b50 tx=0x7fb59400eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:45.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.647 7fb5a97fa700 1 -- 172.21.15.57:0/62668621 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5ac1b4f60 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.647 7fb5a97fa700 1 -- 172.21.15.57:0/62668621 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59400c5a0 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.647 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac1bb840 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.647 7fb5a97fa700 1 -- 172.21.15.57:0/62668621 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb59400f040 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.647 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac1bbc20 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.647 7fb5a97fa700 1 -- 172.21.15.57:0/62668621 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb594022060 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.647 7fb5a97fa700 1 -- 172.21.15.57:0/62668621 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fb594010040 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.648 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac0f08e0 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.651 7fb5a97fa700 1 -- 172.21.15.57:0/62668621 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb59400ede0 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.763 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64} v 0) v1 -- 0x7fb5ac1ae830 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.963 7fb5a97fa700 1 -- 172.21.15.57:0/62668621 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 134+0+0 (secure 0 0 0) 0x7fb594000c30 con 0x7fb5ac0d0f00 2024-04-25T02:05:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.964 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 >> v1:172.21.15.57:6816/43033 conn(0x7fb5900145b0 legacy=0x7fb590016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.964 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0d0f00 msgr2=0x7fb5ac1b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:45.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.964 7fb5b2c72700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0d0f00 0x7fb5ac1b40d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb594006b50 tx=0x7fb59400eca0).stop 2024-04-25T02:05:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.964 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 shutdown_connections 2024-04-25T02:05:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.964 7fb5b2c72700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5ac0d1350 0x7fb5ac1b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.964 7fb5b2c72700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5ac0d80e0 0x7fb5ac0d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.964 7fb5b2c72700 1 --2- 172.21.15.57:0/62668621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5ac0d0f00 0x7fb5ac1b40d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.964 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 >> 172.21.15.57:0/62668621 conn(0x7fb5ac0de0f0 msgr2=0x7fb5ac0c00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.965 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 shutdown_connections 2024-04-25T02:05:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:45.965 7fb5b2c72700 1 -- 172.21.15.57:0/62668621 wait complete. 2024-04-25T02:05:45.971 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2024-04-25T02:05:45.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 64 2024-04-25T02:05:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.117 7f2c3159d700 1 Processor -- start 2024-04-25T02:05:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.117 7f2c3159d700 1 -- start start 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c3159d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c2c10b720 0x7f2c2c1a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c3159d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c1a57e0 0x7f2c2c1a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c3159d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c10bb70 con 0x7f2c2c0f5820 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c3159d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c0fa3a0 con 0x7f2c2c10b720 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c3159d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c1a0a60 con 0x7f2c2c1a57e0 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2adea700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c2c10b720 0x7f2c2c1a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2adea700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c2c10b720 0x7f2c2c1a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43776/0 (socket says 172.21.15.57:43776) 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2bdec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c1a57e0 0x7f2c2c1a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2adea700 1 -- 172.21.15.57:0/3102159068 learned_addr learned my addr 172.21.15.57:0/3102159068 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2bdec700 1 -- 172.21.15.57:0/3102159068 >> v2:172.21.15.57:3300/0 conn(0x7f2c2c10b720 msgr2=0x7f2c2c1a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2bdec700 1 --2- 172.21.15.57:0/3102159068 >> v2:172.21.15.57:3300/0 conn(0x7f2c2c10b720 0x7f2c2c1a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2bdec700 1 -- 172.21.15.57:0/3102159068 >> v1:172.21.15.57:6789/0 conn(0x7f2c2c0f5820 legacy=0x7f2c2c10af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2bdec700 1 -- 172.21.15.57:0/3102159068 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c1a9280 con 0x7f2c2c1a57e0 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2adea700 1 --2- 172.21.15.57:0/3102159068 >> v2:172.21.15.57:3300/0 conn(0x7f2c2c10b720 0x7f2c2c1a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2bdec700 1 --2- 172.21.15.57:0/3102159068 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c1a57e0 0x7f2c2c1a7c40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f2c2c0f45d0 tx=0x7f2c24009cc0).ready entity=mon.2 client_cookie=a35a2c955ce3d6d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.118 7f2c2a5e9700 1 -- 172.21.15.57:0/3102159068 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c2c1a9280 con 0x7f2c2c1a57e0 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c2a5e9700 1 -- 172.21.15.57:0/3102159068 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2400b840 con 0x7f2c2c1a57e0 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c2a5e9700 1 -- 172.21.15.57:0/3102159068 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c2400ba20 con 0x7f2c2c1a57e0 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c3159d700 1 -- 172.21.15.57:0/3102159068 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c1a57e0 msgr2=0x7f2c2c1a7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c3159d700 1 --2- 172.21.15.57:0/3102159068 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c1a57e0 0x7f2c2c1a7c40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f2c2c0f45d0 tx=0x7f2c24009cc0).stop 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c3159d700 1 -- 172.21.15.57:0/3102159068 shutdown_connections 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c3159d700 1 --2- 172.21.15.57:0/3102159068 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c1a57e0 0x7f2c2c1a7c40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c3159d700 1 --2- 172.21.15.57:0/3102159068 >> v2:172.21.15.57:3300/0 conn(0x7f2c2c10b720 0x7f2c2c1a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c3159d700 1 -- 172.21.15.57:0/3102159068 >> 172.21.15.57:0/3102159068 conn(0x7f2c2c113880 msgr2=0x7f2c2c0f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c3159d700 1 -- 172.21.15.57:0/3102159068 shutdown_connections 2024-04-25T02:05:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.119 7f2c3159d700 1 -- 172.21.15.57:0/3102159068 wait complete. 2024-04-25T02:05:46.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.143 7f2c3159d700 1 Processor -- start 2024-04-25T02:05:46.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.143 7f2c3159d700 1 -- start start 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.143 7f2c3159d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c0deb20 0x7f2c2c0d7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.143 7f2c3159d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c2c0d76c0 0x7f2c2c1b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.143 7f2c3159d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c0d7b10 0x7f2c2c1b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.143 7f2c3159d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0a8220 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.143 7f2c3159d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0cc1f0 con 0x7f2c2c0d76c0 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.143 7f2c3159d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0cbe90 con 0x7f2c2c0deb20 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2b5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c0deb20 0x7f2c2c0d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2adea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c2c0d76c0 0x7f2c2c1b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2bdec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c0d7b10 0x7f2c2c1b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2adea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c2c0d76c0 0x7f2c2c1b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39516/0 (socket says 172.21.15.57:39516) 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2adea700 1 -- 172.21.15.57:0/3264885467 learned_addr learned my addr 172.21.15.57:0/3264885467 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2b5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c0deb20 0x7f2c2c0d7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37326/0 (socket says 172.21.15.57:37326) 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2bdec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c0d7b10 0x7f2c2c1b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43778/0 (socket says 172.21.15.57:43778) 2024-04-25T02:05:46.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2bdec700 1 -- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c0deb20 msgr2=0x7f2c2c0d7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2bdec700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c0deb20 0x7f2c2c0d7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2bdec700 1 -- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c2c0d76c0 msgr2=0x7f2c2c1b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2bdec700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c2c0d76c0 0x7f2c2c1b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2bdec700 1 -- 172.21.15.57:0/3264885467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c1b29b0 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2adea700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c2c0d76c0 0x7f2c2c1b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2b5eb700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c0deb20 0x7f2c2c0d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c2bdec700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c0d7b10 0x7f2c2c1b2380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2c2c0df100 tx=0x7f2c24006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c28de6700 1 -- 172.21.15.57:0/3264885467 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c2c1b29b0 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c28de6700 1 -- 172.21.15.57:0/3264885467 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c24011a90 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c1b2c70 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c28de6700 1 -- 172.21.15.57:0/3264885467 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c24017040 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.144 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c1b9730 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.145 7f2c28de6700 1 -- 172.21.15.57:0/3264885467 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f2c2401c470 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.145 7f2c28de6700 1 -- 172.21.15.57:0/3264885467 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2728+0+0 (secure 0 0 0) 0x7f2c24018030 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.145 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c0f06f0 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.149 7f2c28de6700 1 -- 172.21.15.57:0/3264885467 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f2c24011880 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.259 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f2c2c0ab690 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.975 7f2c28de6700 1 -- 172.21.15.57:0/3264885467 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pgp_num": 64}]=0 pool 'cephfs_data' created v14) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2c2400b630 con 0x7f2c2c0d7b10 2024-04-25T02:05:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.981 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 >> v1:172.21.15.57:6816/43033 conn(0x7f2c100145b0 legacy=0x7f2c10016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.981 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c0d7b10 msgr2=0x7f2c2c1b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:46.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.981 7f2c3159d700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c0d7b10 0x7f2c2c1b2380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2c2c0df100 tx=0x7f2c24006c40).stop 2024-04-25T02:05:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.985 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 shutdown_connections 2024-04-25T02:05:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.985 7f2c3159d700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c0d7b10 0x7f2c2c1b2380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.985 7f2c3159d700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c2c0deb20 0x7f2c2c0d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.985 7f2c3159d700 1 --2- 172.21.15.57:0/3264885467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c2c0d76c0 0x7f2c2c1b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:46.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.985 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 >> 172.21.15.57:0/3264885467 conn(0x7f2c2c0c5070 msgr2=0x7f2c2c0f16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.987 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 shutdown_connections 2024-04-25T02:05:46.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:46.988 7f2c3159d700 1 -- 172.21.15.57:0/3264885467 wait complete. 2024-04-25T02:05:47.001 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2024-04-25T02:05:47.025 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:05:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.159 7f0def8c4700 1 Processor -- start 2024-04-25T02:05:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.159 7f0def8c4700 1 -- start start 2024-04-25T02:05:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.159 7f0def8c4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de80f5990 0x7f0de810b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.159 7f0def8c4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de810bb10 0x7f0de81a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.159 7f0def8c4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de81a09f0 con 0x7f0de810b6c0 2024-04-25T02:05:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.159 7f0def8c4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80fa510 con 0x7f0de80f5990 2024-04-25T02:05:47.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.159 7f0def8c4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0de81a0c10 con 0x7f0de810bb10 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de80f5990 0x7f0de810b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0de810b6c0 0x7f0de819fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57476/0 (socket says 172.21.15.57:57476) 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de80f5990 0x7f0de810b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49400/0 (socket says 172.21.15.57:49400) 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de77fe700 1 -- 172.21.15.57:0/4114402130 learned_addr learned my addr 172.21.15.57:0/4114402130 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0decec0700 1 --2- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de810bb10 0x7f0de81a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de6ffd700 1 -- 172.21.15.57:0/4114402130 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763377108 0 0) 0x7f0dd8001110 con 0x7f0de810b6c0 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de7fff700 1 -- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de810bb10 msgr2=0x7f0de81a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de7fff700 1 --2- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de810bb10 0x7f0de81a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de7fff700 1 -- 172.21.15.57:0/4114402130 >> v1:172.21.15.57:6789/0 conn(0x7f0de810b6c0 legacy=0x7f0de819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de7fff700 1 -- 172.21.15.57:0/4114402130 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de81a9350 con 0x7f0de80f5990 2024-04-25T02:05:47.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0decec0700 1 --2- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de810bb10 0x7f0de81a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de7fff700 1 --2- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de80f5990 0x7f0de810b090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0de8103990 tx=0x7f0dd000ba50).ready entity=mon.1 client_cookie=84231344a501f262 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de6ffd700 1 -- 172.21.15.57:0/4114402130 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0de81a9350 con 0x7f0de80f5990 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de6ffd700 1 -- 172.21.15.57:0/4114402130 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000d570 con 0x7f0de80f5990 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0de6ffd700 1 -- 172.21.15.57:0/4114402130 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0dd000d940 con 0x7f0de80f5990 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0def8c4700 1 -- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de80f5990 msgr2=0x7f0de810b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.160 7f0def8c4700 1 --2- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de80f5990 0x7f0de810b090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0de8103990 tx=0x7f0dd000ba50).stop 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.161 7f0def8c4700 1 -- 172.21.15.57:0/4114402130 shutdown_connections 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.161 7f0def8c4700 1 --2- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de810bb10 0x7f0de81a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.161 7f0def8c4700 1 --2- 172.21.15.57:0/4114402130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de80f5990 0x7f0de810b090 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.161 7f0def8c4700 1 -- 172.21.15.57:0/4114402130 >> 172.21.15.57:0/4114402130 conn(0x7f0de81139f0 msgr2=0x7f0de80f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.161 7f0def8c4700 1 -- 172.21.15.57:0/4114402130 shutdown_connections 2024-04-25T02:05:47.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.161 7f0def8c4700 1 -- 172.21.15.57:0/4114402130 wait complete. 2024-04-25T02:05:47.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0def8c4700 1 Processor -- start 2024-04-25T02:05:47.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0def8c4700 1 -- start start 2024-04-25T02:05:47.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0def8c4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de81b15d0 0x7f0de81b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0def8c4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de81b2050 0x7f0de81b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0def8c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0de81b5020 0x7f0de81b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0def8c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80bb670 con 0x7f0de81b5020 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0def8c4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80c9d50 con 0x7f0de81b2050 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0def8c4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80c9100 con 0x7f0de81b15d0 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.185 7f0de77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de81b2050 0x7f0de81b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de81b15d0 0x7f0de81b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0decec0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0de81b5020 0x7f0de81b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de81b2050 0x7f0de81b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49406/0 (socket says 172.21.15.57:49406) 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de77fe700 1 -- 172.21.15.57:0/3746287704 learned_addr learned my addr 172.21.15.57:0/3746287704 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de77fe700 1 -- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de81b15d0 msgr2=0x7f0de81b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de77fe700 1 --2- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de81b15d0 0x7f0de81b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de77fe700 1 -- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0de81b5020 msgr2=0x7f0de81b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de77fe700 1 --2- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0de81b5020 0x7f0de81b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de77fe700 1 -- 172.21.15.57:0/3746287704 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80e09f0 con 0x7f0de81b2050 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de7fff700 1 --2- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de81b15d0 0x7f0de81b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de77fe700 1 --2- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de81b2050 0x7f0de81b49f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0de80c9570 tx=0x7f0dd800c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de57fa700 1 -- 172.21.15.57:0/3746287704 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0de80e09f0 con 0x7f0de81b2050 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de57fa700 1 -- 172.21.15.57:0/3746287704 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd80072e0 con 0x7f0de81b2050 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de81bc0c0 con 0x7f0de81b2050 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0de57fa700 1 -- 172.21.15.57:0/3746287704 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0dd8005810 con 0x7f0de81b2050 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.186 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de81bc4a0 con 0x7f0de81b2050 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.187 7f0de57fa700 1 -- 172.21.15.57:0/3746287704 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0dd8005a10 con 0x7f0de81b2050 2024-04-25T02:05:47.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.187 7f0de57fa700 1 -- 172.21.15.57:0/3746287704 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3078+0+0 (secure 0 0 0) 0x7f0dd8014b20 con 0x7f0de81b2050 2024-04-25T02:05:47.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.187 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de80f0860 con 0x7f0de81b2050 2024-04-25T02:05:47.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.191 7f0de57fa700 1 -- 172.21.15.57:0/3746287704 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f0dd80070d0 con 0x7f0de81b2050 2024-04-25T02:05:47.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.331 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0de80ce3a0 con 0x7f0de81b2050 2024-04-25T02:05:47.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.355 7f0de57fa700 1 -- 172.21.15.57:0/3746287704 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0dd8000c30 con 0x7f0de81b2050 2024-04-25T02:05:47.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.366 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 >> v1:172.21.15.57:6816/43033 conn(0x7f0dcc0145b0 legacy=0x7f0dcc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.366 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de81b2050 msgr2=0x7f0de81b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.366 7f0def8c4700 1 --2- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de81b2050 0x7f0de81b49f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0de80c9570 tx=0x7f0dd800c860).stop 2024-04-25T02:05:47.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.366 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 shutdown_connections 2024-04-25T02:05:47.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.366 7f0def8c4700 1 --2- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0de81b5020 0x7f0de81b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.366 7f0def8c4700 1 --2- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0de81b15d0 0x7f0de81b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.366 7f0def8c4700 1 --2- 172.21.15.57:0/3746287704 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0de81b2050 0x7f0de81b49f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.366 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 >> 172.21.15.57:0/3746287704 conn(0x7f0de80db7a0 msgr2=0x7f0de80c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:47.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.367 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 shutdown_connections 2024-04-25T02:05:47.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.367 7f0def8c4700 1 -- 172.21.15.57:0/3746287704 wait complete. 2024-04-25T02:05:47.377 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T02:05:47.399 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.523 7f3622dae700 1 Processor -- start 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.523 7f3622dae700 1 -- start start 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f3622dae700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0f58a0 0x7f361c0f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f3622dae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f361c0f2290 0x7f361c10ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f3622dae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0f91b0 con 0x7f361c0f1e40 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f3622dae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c10f060 con 0x7f361c0f2290 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f3622dae700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1ac600 con 0x7f361c0f58a0 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f361b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0f58a0 0x7f361c0f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f361bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f361c0f2290 0x7f361c10ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f361b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0f58a0 0x7f361c0f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60426/0 (socket says 172.21.15.57:60426) 2024-04-25T02:05:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f361b7fe700 1 -- 172.21.15.57:0/1702880626 learned_addr learned my addr 172.21.15.57:0/1702880626 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f361bfff700 1 -- 172.21.15.57:0/1702880626 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0f58a0 msgr2=0x7f361c0f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.524 7f361bfff700 1 --2- 172.21.15.57:0/1702880626 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0f58a0 0x7f361c0f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f361bfff700 1 -- 172.21.15.57:0/1702880626 >> v1:172.21.15.57:6789/0 conn(0x7f361c0f1e40 legacy=0x7f361c10e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f361affd700 1 -- 172.21.15.57:0/1702880626 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485545121 0 0) 0x7f3604001110 con 0x7f361c0f1e40 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f361bfff700 1 -- 172.21.15.57:0/1702880626 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c1ac7b0 con 0x7f361c0f2290 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f361b7fe700 1 --2- 172.21.15.57:0/1702880626 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0f58a0 0x7f361c0f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f361bfff700 1 --2- 172.21.15.57:0/1702880626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0f2290 0x7f361c10ea30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f36140032f0 tx=0x7f3614009d10).ready entity=mon.0 client_cookie=a835e2eeb2b65e2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f361affd700 1 -- 172.21.15.57:0/1702880626 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f361c1ac7b0 con 0x7f361c0f2290 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f361affd700 1 -- 172.21.15.57:0/1702880626 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361400b800 con 0x7f361c0f2290 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f361affd700 1 -- 172.21.15.57:0/1702880626 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f361400b9e0 con 0x7f361c0f2290 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f3622dae700 1 -- 172.21.15.57:0/1702880626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0f2290 msgr2=0x7f361c10ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f3622dae700 1 --2- 172.21.15.57:0/1702880626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0f2290 0x7f361c10ea30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f36140032f0 tx=0x7f3614009d10).stop 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f3622dae700 1 -- 172.21.15.57:0/1702880626 shutdown_connections 2024-04-25T02:05:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f3622dae700 1 --2- 172.21.15.57:0/1702880626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0f2290 0x7f361c10ea30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f3622dae700 1 --2- 172.21.15.57:0/1702880626 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0f58a0 0x7f361c0f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.525 7f3622dae700 1 -- 172.21.15.57:0/1702880626 >> 172.21.15.57:0/1702880626 conn(0x7f361c1139f0 msgr2=0x7f361c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:47.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.526 7f3622dae700 1 -- 172.21.15.57:0/1702880626 shutdown_connections 2024-04-25T02:05:47.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.526 7f3622dae700 1 -- 172.21.15.57:0/1702880626 wait complete. 2024-04-25T02:05:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.549 7f3622dae700 1 Processor -- start 2024-04-25T02:05:47.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.549 7f3622dae700 1 -- start start 2024-04-25T02:05:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f3622dae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0c4fe0 0x7f361c0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f3622dae700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f361c0cb9f0 0x7f361c0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f3622dae700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0cbe40 0x7f361c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f3622dae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0effc0 con 0x7f361c0c4fe0 2024-04-25T02:05:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f3622dae700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0bc340 con 0x7f361c0cb9f0 2024-04-25T02:05:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f3622dae700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0cd980 con 0x7f361c0cbe40 2024-04-25T02:05:47.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0c4fe0 0x7f361c0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0c4fe0 0x7f361c0cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57066/0 (socket says 172.21.15.57:57066) 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361b7fe700 1 -- 172.21.15.57:0/1721409815 learned_addr learned my addr 172.21.15.57:0/1721409815 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361bfff700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0cbe40 0x7f361c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f3612ffd700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f361c0cb9f0 0x7f361c0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361bfff700 1 -- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f361c0cb9f0 msgr2=0x7f361c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361bfff700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f361c0cb9f0 0x7f361c0cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361bfff700 1 -- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0c4fe0 msgr2=0x7f361c0cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361bfff700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0c4fe0 0x7f361c0cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361bfff700 1 -- 172.21.15.57:0/1721409815 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0cd240 con 0x7f361c0cbe40 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.550 7f361b7fe700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0c4fe0 0x7f361c0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.551 7f361bfff700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0cbe40 0x7f361c0ccc10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f361c0c3080 tx=0x7f3614006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.551 7f36197fa700 1 -- 172.21.15.57:0/1721409815 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f361c0cd240 con 0x7f361c0cbe40 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.551 7f36197fa700 1 -- 172.21.15.57:0/1721409815 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614011ae0 con 0x7f361c0cbe40 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.551 7f3622dae700 1 -- 172.21.15.57:0/1721409815 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c1bb970 con 0x7f361c0cbe40 2024-04-25T02:05:47.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.551 7f36197fa700 1 -- 172.21.15.57:0/1721409815 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3614017040 con 0x7f361c0cbe40 2024-04-25T02:05:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.551 7f3622dae700 1 -- 172.21.15.57:0/1721409815 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c1bbd50 con 0x7f361c0cbe40 2024-04-25T02:05:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.551 7f36197fa700 1 -- 172.21.15.57:0/1721409815 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f361401c470 con 0x7f361c0cbe40 2024-04-25T02:05:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.551 7f36197fa700 1 -- 172.21.15.57:0/1721409815 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3614018030 con 0x7f361c0cbe40 2024-04-25T02:05:47.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.552 7f3622dae700 1 -- 172.21.15.57:0/1721409815 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c0f0860 con 0x7f361c0cbe40 2024-04-25T02:05:47.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.555 7f36197fa700 1 -- 172.21.15.57:0/1721409815 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f36140118d0 con 0x7f361c0cbe40 2024-04-25T02:05:47.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.667 7f3622dae700 1 -- 172.21.15.57:0/1721409815 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f361c0cd4a0 con 0x7f361c0cbe40 2024-04-25T02:05:47.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.668 7f36197fa700 1 -- 172.21.15.57:0/1721409815 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8742 (secure 0 0 0) 0x7f3614037240 con 0x7f361c0cbe40 2024-04-25T02:05:47.673 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:47.673 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:47.332878","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:47.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 -- 172.21.15.57:0/1721409815 >> v1:172.21.15.57:6816/43033 conn(0x7f36000145b0 legacy=0x7f3600016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 -- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0cbe40 msgr2=0x7f361c0ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0cbe40 0x7f361c0ccc10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f361c0c3080 tx=0x7f3614006c40).stop 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 -- 172.21.15.57:0/1721409815 shutdown_connections 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f361c0cbe40 0x7f361c0ccc10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f361c0c4fe0 0x7f361c0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 --2- 172.21.15.57:0/1721409815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f361c0cb9f0 0x7f361c0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 -- 172.21.15.57:0/1721409815 >> 172.21.15.57:0/1721409815 conn(0x7f361c0c5be0 msgr2=0x7f361c0bdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 -- 172.21.15.57:0/1721409815 shutdown_connections 2024-04-25T02:05:47.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.669 7f3622dae700 1 -- 172.21.15.57:0/1721409815 wait complete. 2024-04-25T02:05:47.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:47.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44f456700 1 Processor -- start 2024-04-25T02:05:47.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44f456700 1 -- start start 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44f456700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480f5a10 0x7fb44810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44f456700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb44810b740 0x7fb44819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44f456700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb44810bb90 0x7fb4481a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44f456700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4480fa590 con 0x7fb44810bb90 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44f456700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4481a08a0 con 0x7fb4480f5a10 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44f456700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4481a0ad0 con 0x7fb44810b740 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44ca52700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb44810bb90 0x7fb4481a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb447fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480f5a10 0x7fb44810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb4477fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb44810b740 0x7fb44819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44ca52700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb44810bb90 0x7fb4481a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57070/0 (socket says 172.21.15.57:57070) 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb44ca52700 1 -- 172.21.15.57:0/3835185234 learned_addr learned my addr 172.21.15.57:0/3835185234 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.851 7fb447fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480f5a10 0x7fb44810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49416/0 (socket says 172.21.15.57:49416) 2024-04-25T02:05:47.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb4477fe700 1 -- 172.21.15.57:0/3835185234 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480f5a10 msgr2=0x7fb44810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb4477fe700 1 --2- 172.21.15.57:0/3835185234 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480f5a10 0x7fb44810b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb4477fe700 1 -- 172.21.15.57:0/3835185234 >> v2:172.21.15.57:3300/0 conn(0x7fb44810bb90 msgr2=0x7fb4481a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb4477fe700 1 --2- 172.21.15.57:0/3835185234 >> v2:172.21.15.57:3300/0 conn(0x7fb44810bb90 0x7fb4481a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb4477fe700 1 -- 172.21.15.57:0/3835185234 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4480f1890 con 0x7fb44810b740 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb44ca52700 1 --2- 172.21.15.57:0/3835185234 >> v2:172.21.15.57:3300/0 conn(0x7fb44810bb90 0x7fb4481a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb447fff700 1 --2- 172.21.15.57:0/3835185234 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480f5a10 0x7fb44810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb4477fe700 1 --2- 172.21.15.57:0/3835185234 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb44810b740 0x7fb44819fc40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb430002f70 tx=0x7fb43000b970).ready entity=mon.2 client_cookie=31bff8c69dcc3335 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb446ffd700 1 -- 172.21.15.57:0/3835185234 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4480f1890 con 0x7fb44810b740 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb446ffd700 1 -- 172.21.15.57:0/3835185234 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43000d570 con 0x7fb44810b740 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb446ffd700 1 -- 172.21.15.57:0/3835185234 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb43000d940 con 0x7fb44810b740 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb44f456700 1 -- 172.21.15.57:0/3835185234 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb44810b740 msgr2=0x7fb44819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.852 7fb44f456700 1 --2- 172.21.15.57:0/3835185234 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb44810b740 0x7fb44819fc40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb430002f70 tx=0x7fb43000b970).stop 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.853 7fb44f456700 1 -- 172.21.15.57:0/3835185234 shutdown_connections 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.853 7fb44f456700 1 --2- 172.21.15.57:0/3835185234 >> v2:172.21.15.57:3300/0 conn(0x7fb44810bb90 0x7fb4481a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.853 7fb44f456700 1 --2- 172.21.15.57:0/3835185234 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480f5a10 0x7fb44810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.853 7fb44f456700 1 --2- 172.21.15.57:0/3835185234 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb44810b740 0x7fb44819fc40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.853 7fb44f456700 1 -- 172.21.15.57:0/3835185234 >> 172.21.15.57:0/3835185234 conn(0x7fb448113a70 msgr2=0x7fb4480f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.853 7fb44f456700 1 -- 172.21.15.57:0/3835185234 shutdown_connections 2024-04-25T02:05:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.853 7fb44f456700 1 -- 172.21.15.57:0/3835185234 wait complete. 2024-04-25T02:05:47.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44f456700 1 Processor -- start 2024-04-25T02:05:47.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44f456700 1 -- start start 2024-04-25T02:05:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44f456700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480ca3b0 0x7fb4480ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44f456700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4480cae30 0x7fb4481b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44f456700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4481b2670 0x7fb4481b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44f456700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4480bd050 con 0x7fb4480cae30 2024-04-25T02:05:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44f456700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4480bd760 con 0x7fb4480ca3b0 2024-04-25T02:05:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44f456700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4480c4310 con 0x7fb4481b2670 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb447fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480ca3b0 0x7fb4480ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44ca52700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4481b2670 0x7fb4481b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb447fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480ca3b0 0x7fb4480ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49420/0 (socket says 172.21.15.57:49420) 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb447fff700 1 -- 172.21.15.57:0/2988830408 learned_addr learned my addr 172.21.15.57:0/2988830408 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb44ca52700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4481b2670 0x7fb4481b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60464/0 (socket says 172.21.15.57:60464) 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.877 7fb4477fe700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4480cae30 0x7fb4481b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb44ca52700 1 -- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480ca3b0 msgr2=0x7fb4480ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb44ca52700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480ca3b0 0x7fb4480ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb44ca52700 1 -- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4480cae30 msgr2=0x7fb4481b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb44ca52700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4480cae30 0x7fb4481b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb44ca52700 1 -- 172.21.15.57:0/2988830408 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4480bc230 con 0x7fb4481b2670 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb447fff700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480ca3b0 0x7fb4480ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb4477fe700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4480cae30 0x7fb4481b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb44ca52700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4481b2670 0x7fb4481b2ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb4480bdd20 tx=0x7fb44000ed50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb4457fa700 1 -- 172.21.15.57:0/2988830408 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4480bc230 con 0x7fb4481b2670 2024-04-25T02:05:47.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb4457fa700 1 -- 172.21.15.57:0/2988830408 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44000c830 con 0x7fb4481b2670 2024-04-25T02:05:47.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb44f456700 1 -- 172.21.15.57:0/2988830408 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4481b9730 con 0x7fb4481b2670 2024-04-25T02:05:47.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb4457fa700 1 -- 172.21.15.57:0/2988830408 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb44000f040 con 0x7fb4481b2670 2024-04-25T02:05:47.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb44f456700 1 -- 172.21.15.57:0/2988830408 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4481b9b10 con 0x7fb4481b2670 2024-04-25T02:05:47.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb4457fa700 1 -- 172.21.15.57:0/2988830408 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb440022060 con 0x7fb4481b2670 2024-04-25T02:05:47.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.878 7fb4457fa700 1 -- 172.21.15.57:0/2988830408 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fb440010040 con 0x7fb4481b2670 2024-04-25T02:05:47.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.879 7fb44f456700 1 -- 172.21.15.57:0/2988830408 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4480f08e0 con 0x7fb4481b2670 2024-04-25T02:05:47.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.882 7fb4457fa700 1 -- 172.21.15.57:0/2988830408 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb44000c620 con 0x7fb4481b2670 2024-04-25T02:05:47.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.993 7fb44f456700 1 -- 172.21.15.57:0/2988830408 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4480e2430 con 0x7fb4481b2670 2024-04-25T02:05:47.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.993 7fb4457fa700 1 -- 172.21.15.57:0/2988830408 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8742 (secure 0 0 0) 0x7fb440000fb0 con 0x7fb4481b2670 2024-04-25T02:05:47.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:47.999 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:47.332878","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:48.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 -- 172.21.15.57:0/2988830408 >> v1:172.21.15.57:6816/43033 conn(0x7fb42c0145b0 legacy=0x7fb42c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 -- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4481b2670 msgr2=0x7fb4481b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4481b2670 0x7fb4481b2ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb4480bdd20 tx=0x7fb44000ed50).stop 2024-04-25T02:05:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 -- 172.21.15.57:0/2988830408 shutdown_connections 2024-04-25T02:05:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4481b2670 0x7fb4481b2ac0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4480ca3b0 0x7fb4480ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 --2- 172.21.15.57:0/2988830408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4480cae30 0x7fb4481b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 -- 172.21.15.57:0/2988830408 >> 172.21.15.57:0/2988830408 conn(0x7fb4480be6e0 msgr2=0x7fb4480c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 -- 172.21.15.57:0/2988830408 shutdown_connections 2024-04-25T02:05:48.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:47.995 7fb44f456700 1 -- 172.21.15.57:0/2988830408 wait complete. 2024-04-25T02:05:48.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:05:48.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f113ee32700 1 Processor -- start 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f113ee32700 1 -- start start 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f113ee32700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380f5a10 0x7f113810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f113ee32700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113810b740 0x7f113819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f113ee32700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f113810bb90 0x7f11381a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f113ee32700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11380fa590 con 0x7f113810bb90 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f113ee32700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11381a08a0 con 0x7f113810b740 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f113ee32700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11381a0ad0 con 0x7f11380f5a10 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f1137fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f113810bb90 0x7f11381a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f11377fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380f5a10 0x7f113810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f1136ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113810b740 0x7f113819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f1137fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f113810bb90 0x7f11381a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57092/0 (socket says 172.21.15.57:57092) 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.140 7f1137fff700 1 -- 172.21.15.57:0/367330118 learned_addr learned my addr 172.21.15.57:0/367330118 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f1137fff700 1 -- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380f5a10 msgr2=0x7f113810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f1137fff700 1 --2- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380f5a10 0x7f113810b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f1137fff700 1 -- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113810b740 msgr2=0x7f113819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f1137fff700 1 --2- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113810b740 0x7f113819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f1137fff700 1 -- 172.21.15.57:0/367330118 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11381a73b0 con 0x7f113810bb90 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f1136ffd700 1 --2- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113810b740 0x7f113819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f1137fff700 1 --2- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113810bb90 0x7f11381a0270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f11300032f0 tx=0x7f113000d5d0).ready entity=mon.0 client_cookie=1cff290ef3c52c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f11367fc700 1 -- 172.21.15.57:0/367330118 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11381a73b0 con 0x7f113810bb90 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f11367fc700 1 -- 172.21.15.57:0/367330118 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130010660 con 0x7f113810bb90 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f11367fc700 1 -- 172.21.15.57:0/367330118 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1130010a30 con 0x7f113810bb90 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f113ee32700 1 -- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113810bb90 msgr2=0x7f11381a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.141 7f113ee32700 1 --2- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113810bb90 0x7f11381a0270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f11300032f0 tx=0x7f113000d5d0).stop 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.142 7f113ee32700 1 -- 172.21.15.57:0/367330118 shutdown_connections 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.142 7f113ee32700 1 --2- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113810bb90 0x7f11381a0270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.142 7f113ee32700 1 --2- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380f5a10 0x7f113810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.142 7f113ee32700 1 --2- 172.21.15.57:0/367330118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113810b740 0x7f113819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.142 7f113ee32700 1 -- 172.21.15.57:0/367330118 >> 172.21.15.57:0/367330118 conn(0x7f1138113a70 msgr2=0x7f11380f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:48.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.142 7f113ee32700 1 -- 172.21.15.57:0/367330118 shutdown_connections 2024-04-25T02:05:48.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.142 7f113ee32700 1 -- 172.21.15.57:0/367330118 wait complete. 2024-04-25T02:05:48.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f113ee32700 1 Processor -- start 2024-04-25T02:05:48.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f113ee32700 1 -- start start 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f113ee32700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11381a9220 0x7f11381a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f113ee32700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11381a9ca0 0x7f11380d6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f113ee32700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380d6d90 0x7f11381b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f113ee32700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380ccc80 con 0x7f11381a9220 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f113ee32700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11380c3530 con 0x7f11381a9ca0 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f113ee32700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11380cd490 con 0x7f11380d6d90 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f11377fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11381a9220 0x7f11381a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f1136ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11381a9ca0 0x7f11380d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f11377fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11381a9220 0x7f11381a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57108/0 (socket says 172.21.15.57:57108) 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f1137fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380d6d90 0x7f11381b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f11377fe700 1 -- 172.21.15.57:0/3547898392 learned_addr learned my addr 172.21.15.57:0/3547898392 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.166 7f1136ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11381a9ca0 0x7f11380d6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49432/0 (socket says 172.21.15.57:49432) 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f11377fe700 1 -- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380d6d90 msgr2=0x7f11381b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f11377fe700 1 --2- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380d6d90 0x7f11381b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f11377fe700 1 -- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11381a9ca0 msgr2=0x7f11380d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f11377fe700 1 --2- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11381a9ca0 0x7f11380d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f11377fe700 1 -- 172.21.15.57:0/3547898392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380f5c30 con 0x7f11381a9220 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f1136ffd700 1 --2- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11381a9ca0 0x7f11380d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f11377fe700 1 --2- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11381a9220 0x7f11381a9670 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f11380cce30 tx=0x7f112c00ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f1134ff9700 1 -- 172.21.15.57:0/3547898392 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11380f5c30 con 0x7f11381a9220 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f1134ff9700 1 -- 172.21.15.57:0/3547898392 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c00c940 con 0x7f11381a9220 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f113ee32700 1 -- 172.21.15.57:0/3547898392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11380cc510 con 0x7f11381a9220 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f1134ff9700 1 -- 172.21.15.57:0/3547898392 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f112c00f040 con 0x7f11381a9220 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f113ee32700 1 -- 172.21.15.57:0/3547898392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11380d73c0 con 0x7f11381a9220 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f1134ff9700 1 -- 172.21.15.57:0/3547898392 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f112c011070 con 0x7f11381a9220 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.167 7f1134ff9700 1 -- 172.21.15.57:0/3547898392 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f112c010040 con 0x7f11381a9220 2024-04-25T02:05:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.168 7f113ee32700 1 -- 172.21.15.57:0/3547898392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11380f08e0 con 0x7f11381a9220 2024-04-25T02:05:48.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.171 7f1134ff9700 1 -- 172.21.15.57:0/3547898392 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f112c00c540 con 0x7f11381a9220 2024-04-25T02:05:48.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.317 7f113ee32700 1 -- 172.21.15.57:0/3547898392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f11380a61a0 con 0x7f11381a9220 2024-04-25T02:05:48.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.346 7f1134ff9700 1 -- 172.21.15.57:0/3547898392 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7f112c000c30 con 0x7f11381a9220 2024-04-25T02:05:48.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 -- 172.21.15.57:0/3547898392 >> v1:172.21.15.57:6816/43033 conn(0x7f11180145b0 legacy=0x7f1118016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 -- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11381a9220 msgr2=0x7f11381a9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 --2- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11381a9220 0x7f11381a9670 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f11380cce30 tx=0x7f112c00ed00).stop 2024-04-25T02:05:48.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 -- 172.21.15.57:0/3547898392 shutdown_connections 2024-04-25T02:05:48.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 --2- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11380d6d90 0x7f11381b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 --2- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11381a9220 0x7f11381a9670 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 --2- 172.21.15.57:0/3547898392 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11381a9ca0 0x7f11380d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 -- 172.21.15.57:0/3547898392 >> 172.21.15.57:0/3547898392 conn(0x7f11380e1110 msgr2=0x7f11380c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:48.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 -- 172.21.15.57:0/3547898392 shutdown_connections 2024-04-25T02:05:48.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.347 7f113ee32700 1 -- 172.21.15.57:0/3547898392 wait complete. 2024-04-25T02:05:48.364 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:05:48.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:05:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.494 7f0eee3a7700 1 Processor -- start 2024-04-25T02:05:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.494 7f0eee3a7700 1 -- start start 2024-04-25T02:05:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0eee3a7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80f2010 0x7f0ee81a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0eee3a7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ee81a8c00 0x7f0ee81ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0eee3a7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee80f91b0 con 0x7f0ee80f58a0 2024-04-25T02:05:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0eee3a7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee80f2460 con 0x7f0ee81a8c00 2024-04-25T02:05:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0eee3a7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80f2660 con 0x7f0ee80f2010 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee6885700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80f2010 0x7f0ee81a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee6885700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80f2010 0x7f0ee81a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60502/0 (socket says 172.21.15.57:60502) 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee6885700 1 -- 172.21.15.57:0/3680182867 learned_addr learned my addr 172.21.15.57:0/3680182867 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee7887700 1 --2- 172.21.15.57:0/3680182867 >> v2:172.21.15.57:3300/0 conn(0x7f0ee81a8c00 0x7f0ee81ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee7887700 1 -- 172.21.15.57:0/3680182867 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80f2010 msgr2=0x7f0ee81a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee7887700 1 --2- 172.21.15.57:0/3680182867 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80f2010 0x7f0ee81a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee7887700 1 -- 172.21.15.57:0/3680182867 >> v1:172.21.15.57:6789/0 conn(0x7f0ee80f58a0 legacy=0x7f0ee80f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee6084700 1 -- 172.21.15.57:0/3680182867 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947907754 0 0) 0x7f0ed8001110 con 0x7f0ee80f58a0 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee7887700 1 -- 172.21.15.57:0/3680182867 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee81ac6a0 con 0x7f0ee81a8c00 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee6885700 1 --2- 172.21.15.57:0/3680182867 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80f2010 0x7f0ee81a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.495 7f0ee7887700 1 --2- 172.21.15.57:0/3680182867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a8c00 0x7f0ee81ab060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0ee00032f0 tx=0x7f0ee0009d10).ready entity=mon.0 client_cookie=d6df656fed7f0f45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0ee6084700 1 -- 172.21.15.57:0/3680182867 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ee81ac6a0 con 0x7f0ee81a8c00 2024-04-25T02:05:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0ee6084700 1 -- 172.21.15.57:0/3680182867 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee000b7a0 con 0x7f0ee81a8c00 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0ee6084700 1 -- 172.21.15.57:0/3680182867 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ee000b980 con 0x7f0ee81a8c00 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0eee3a7700 1 -- 172.21.15.57:0/3680182867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a8c00 msgr2=0x7f0ee81ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0eee3a7700 1 --2- 172.21.15.57:0/3680182867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a8c00 0x7f0ee81ab060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0ee00032f0 tx=0x7f0ee0009d10).stop 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0eee3a7700 1 -- 172.21.15.57:0/3680182867 shutdown_connections 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0eee3a7700 1 --2- 172.21.15.57:0/3680182867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a8c00 0x7f0ee81ab060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0eee3a7700 1 --2- 172.21.15.57:0/3680182867 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80f2010 0x7f0ee81a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0eee3a7700 1 -- 172.21.15.57:0/3680182867 >> 172.21.15.57:0/3680182867 conn(0x7f0ee81139f0 msgr2=0x7f0ee80f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0eee3a7700 1 -- 172.21.15.57:0/3680182867 shutdown_connections 2024-04-25T02:05:48.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.496 7f0eee3a7700 1 -- 172.21.15.57:0/3680182867 wait complete. 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0eee3a7700 1 Processor -- start 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0eee3a7700 1 -- start start 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0eee3a7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80d5990 0x7f0ee80d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0eee3a7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee80d6410 0x7f0ee81a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0eee3a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a7490 0x7f0ee81bb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0eee3a7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80c7870 con 0x7f0ee81a7490 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0eee3a7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80d7370 con 0x7f0ee80d6410 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0eee3a7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80c7570 con 0x7f0ee80d5990 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0ee7086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80d5990 0x7f0ee80d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0ee7887700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a7490 0x7f0ee81bb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0ee7887700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a7490 0x7f0ee81bb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57132/0 (socket says 172.21.15.57:57132) 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0ee7887700 1 -- 172.21.15.57:0/2679694371 learned_addr learned my addr 172.21.15.57:0/2679694371 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0ee7086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80d5990 0x7f0ee80d5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60508/0 (socket says 172.21.15.57:60508) 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.520 7f0ee6885700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee80d6410 0x7f0ee81a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee7086700 1 -- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee80d6410 msgr2=0x7f0ee81a6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee7086700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee80d6410 0x7f0ee81a6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee7086700 1 -- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a7490 msgr2=0x7f0ee81bb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee7086700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a7490 0x7f0ee81bb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee7086700 1 -- 172.21.15.57:0/2679694371 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80c7100 con 0x7f0ee80d5990 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee6885700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee80d6410 0x7f0ee81a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee7887700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a7490 0x7f0ee81bb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee7086700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80d5990 0x7f0ee80d5de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0ee80cba10 tx=0x7f0ed800c7c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee4881700 1 -- 172.21.15.57:0/2679694371 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ee80c7100 con 0x7f0ee80d5990 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee4881700 1 -- 172.21.15.57:0/2679694371 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed8007030 con 0x7f0ee80d5990 2024-04-25T02:05:48.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee81a78e0 con 0x7f0ee80d5990 2024-04-25T02:05:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0ee4881700 1 -- 172.21.15.57:0/2679694371 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ed8006520 con 0x7f0ee80d5990 2024-04-25T02:05:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.521 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee81bbe40 con 0x7f0ee80d5990 2024-04-25T02:05:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.522 7f0ee4881700 1 -- 172.21.15.57:0/2679694371 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0ed801a020 con 0x7f0ee80d5990 2024-04-25T02:05:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.522 7f0ee4881700 1 -- 172.21.15.57:0/2679694371 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f0ed8003c20 con 0x7f0ee80d5990 2024-04-25T02:05:48.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.522 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee80f0860 con 0x7f0ee80d5990 2024-04-25T02:05:48.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.526 7f0ee4881700 1 -- 172.21.15.57:0/2679694371 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f0ed8007db0 con 0x7f0ee80d5990 2024-04-25T02:05:48.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:48.669 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ee81ae840 con 0x7f0ee80d5990 2024-04-25T02:05:49.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.377 7f0ee4881700 1 -- 172.21.15.57:0/2679694371 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ed8000c30 con 0x7f0ee80d5990 2024-04-25T02:05:49.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 >> v1:172.21.15.57:6816/43033 conn(0x7f0ecc0145b0 legacy=0x7f0ecc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80d5990 msgr2=0x7f0ee80d5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80d5990 0x7f0ee80d5de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0ee80cba10 tx=0x7f0ed800c7c0).stop 2024-04-25T02:05:49.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 shutdown_connections 2024-04-25T02:05:49.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee81a7490 0x7f0ee81bb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee80d5990 0x7f0ee80d5de0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 --2- 172.21.15.57:0/2679694371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee80d6410 0x7f0ee81a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 >> 172.21.15.57:0/2679694371 conn(0x7f0ee80cc440 msgr2=0x7f0ee80da420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:49.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 shutdown_connections 2024-04-25T02:05:49.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.379 7f0eee3a7700 1 -- 172.21.15.57:0/2679694371 wait complete. 2024-04-25T02:05:49.398 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:05:49.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:05:49.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90fdde2700 1 Processor -- start 2024-04-25T02:05:49.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90fdde2700 1 -- start start 2024-04-25T02:05:49.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90fdde2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90f80f5920 0x7f90f810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90fdde2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f810c970 0x7f90f80f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90fdde2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f810cdc0 0x7f90f80f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90fdde2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f80fa290 con 0x7f90f80f5920 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90fdde2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80f95c0 con 0x7f90f810c970 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90fdde2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80f24f0 con 0x7f90f810cdc0 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90f6ab2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90f80f5920 0x7f90f810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90f72b3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f810cdc0 0x7f90f80f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90ee2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f810c970 0x7f90f80f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90f72b3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f810cdc0 0x7f90f80f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60514/0 (socket says 172.21.15.57:60514) 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90ee2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f810c970 0x7f90f80f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49450/0 (socket says 172.21.15.57:49450) 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90f6ab2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90f80f5920 0x7f90f810c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57136/0 (socket says 172.21.15.57:57136) 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.531 7f90f72b3700 1 -- 172.21.15.57:0/1236961009 learned_addr learned my addr 172.21.15.57:0/1236961009 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f72b3700 1 -- 172.21.15.57:0/1236961009 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f810c970 msgr2=0x7f90f80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f72b3700 1 --2- 172.21.15.57:0/1236961009 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f810c970 0x7f90f80f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f72b3700 1 -- 172.21.15.57:0/1236961009 >> v2:172.21.15.57:3300/0 conn(0x7f90f80f5920 msgr2=0x7f90f810c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f72b3700 1 --2- 172.21.15.57:0/1236961009 >> v2:172.21.15.57:3300/0 conn(0x7f90f80f5920 0x7f90f810c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f72b3700 1 -- 172.21.15.57:0/1236961009 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80f2720 con 0x7f90f810cdc0 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f6ab2700 1 --2- 172.21.15.57:0/1236961009 >> v2:172.21.15.57:3300/0 conn(0x7f90f80f5920 0x7f90f810c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f72b3700 1 --2- 172.21.15.57:0/1236961009 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f810cdc0 0x7f90f80f1ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f90f80f4640 tx=0x7f90f0009dc0).ready entity=mon.2 client_cookie=129a3cc24dad6c75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f62b1700 1 -- 172.21.15.57:0/1236961009 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90f80f2720 con 0x7f90f810cdc0 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f62b1700 1 -- 172.21.15.57:0/1236961009 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f000b8d0 con 0x7f90f810cdc0 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90f62b1700 1 -- 172.21.15.57:0/1236961009 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90f000bab0 con 0x7f90f810cdc0 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90fdde2700 1 -- 172.21.15.57:0/1236961009 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f810cdc0 msgr2=0x7f90f80f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.532 7f90fdde2700 1 --2- 172.21.15.57:0/1236961009 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f810cdc0 0x7f90f80f1ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f90f80f4640 tx=0x7f90f0009dc0).stop 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.533 7f90fdde2700 1 -- 172.21.15.57:0/1236961009 shutdown_connections 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.533 7f90fdde2700 1 --2- 172.21.15.57:0/1236961009 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f810cdc0 0x7f90f80f1ec0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.533 7f90fdde2700 1 --2- 172.21.15.57:0/1236961009 >> v2:172.21.15.57:3300/0 conn(0x7f90f80f5920 0x7f90f810c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.533 7f90fdde2700 1 --2- 172.21.15.57:0/1236961009 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f810c970 0x7f90f80f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.533 7f90fdde2700 1 -- 172.21.15.57:0/1236961009 >> 172.21.15.57:0/1236961009 conn(0x7f90f8113a70 msgr2=0x7f90f80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:49.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.533 7f90fdde2700 1 -- 172.21.15.57:0/1236961009 shutdown_connections 2024-04-25T02:05:49.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.533 7f90fdde2700 1 -- 172.21.15.57:0/1236961009 wait complete. 2024-04-25T02:05:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.556 7f90fdde2700 1 Processor -- start 2024-04-25T02:05:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90fdde2700 1 -- start start 2024-04-25T02:05:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90fdde2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f81aba60 0x7f90f81abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90fdde2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90f81ac4e0 0x7f90f81b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90fdde2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f81b2a90 0x7f90f81b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90fdde2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80f0250 con 0x7f90f81ac4e0 2024-04-25T02:05:49.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90fdde2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80c4af0 con 0x7f90f81aba60 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90fdde2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80dfc20 con 0x7f90f81b2a90 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90f6ab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f81aba60 0x7f90f81abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90ee2b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90f81ac4e0 0x7f90f81b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90f72b3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f81b2a90 0x7f90f81b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90f6ab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f81aba60 0x7f90f81abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49456/0 (socket says 172.21.15.57:49456) 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90f6ab2700 1 -- 172.21.15.57:0/412499780 learned_addr learned my addr 172.21.15.57:0/412499780 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90ee2b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90f81ac4e0 0x7f90f81b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57148/0 (socket says 172.21.15.57:57148) 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90ee2b1700 1 -- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f81b2a90 msgr2=0x7f90f81b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90ee2b1700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f81b2a90 0x7f90f81b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90ee2b1700 1 -- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f81aba60 msgr2=0x7f90f81abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90ee2b1700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f81aba60 0x7f90f81abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90ee2b1700 1 -- 172.21.15.57:0/412499780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f81b9be0 con 0x7f90f81ac4e0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90f72b3700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f81b2a90 0x7f90f81b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.557 7f90f6ab2700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f81aba60 0x7f90f81abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.558 7f90ee2b1700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90f81ac4e0 0x7f90f81b2460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f90f80df440 tx=0x7f90e000ec80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.558 7f90f4aae700 1 -- 172.21.15.57:0/412499780 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90f81b9be0 con 0x7f90f81ac4e0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.558 7f90f4aae700 1 -- 172.21.15.57:0/412499780 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000c9a0 con 0x7f90f81ac4e0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.558 7f90fdde2700 1 -- 172.21.15.57:0/412499780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f81b9de0 con 0x7f90f81ac4e0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.558 7f90f4aae700 1 -- 172.21.15.57:0/412499780 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90e000f040 con 0x7f90f81ac4e0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.558 7f90fdde2700 1 -- 172.21.15.57:0/412499780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f81b9fe0 con 0x7f90f81ac4e0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.558 7f90f4aae700 1 -- 172.21.15.57:0/412499780 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f90e0011070 con 0x7f90f81ac4e0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.558 7f90f4aae700 1 -- 172.21.15.57:0/412499780 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f90e0010040 con 0x7f90f81ac4e0 2024-04-25T02:05:49.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.559 7f90fdde2700 1 -- 172.21.15.57:0/412499780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f80f08e0 con 0x7f90f81ac4e0 2024-04-25T02:05:49.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.562 7f90f4aae700 1 -- 172.21.15.57:0/412499780 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f90e000c5a0 con 0x7f90f81ac4e0 2024-04-25T02:05:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.704 7f90fdde2700 1 -- 172.21.15.57:0/412499780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90f81acaf0 con 0x7f90f81ac4e0 2024-04-25T02:05:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.704 7f90f4aae700 1 -- 172.21.15.57:0/412499780 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1702 (secure 0 0 0) 0x7f90e0000c30 con 0x7f90f81ac4e0 2024-04-25T02:05:49.710 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:49.710 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:05:47.333033","modified":"2024-04-25 02:05:49.360768","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:05:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 -- 172.21.15.57:0/412499780 >> v1:172.21.15.57:6816/43033 conn(0x7f90dc0145b0 legacy=0x7f90dc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 -- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90f81ac4e0 msgr2=0x7f90f81b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90f81ac4e0 0x7f90f81b2460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f90f80df440 tx=0x7f90e000ec80).stop 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 -- 172.21.15.57:0/412499780 shutdown_connections 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90f81b2a90 0x7f90f81b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90f81aba60 0x7f90f81abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 --2- 172.21.15.57:0/412499780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90f81ac4e0 0x7f90f81b2460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 -- 172.21.15.57:0/412499780 >> 172.21.15.57:0/412499780 conn(0x7f90f80c91d0 msgr2=0x7f90f80c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 -- 172.21.15.57:0/412499780 shutdown_connections 2024-04-25T02:05:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.706 7f90fdde2700 1 -- 172.21.15.57:0/412499780 wait complete. 2024-04-25T02:05:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T02:05:49.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:49.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.848 7fc21c3fa700 1 Processor -- start 2024-04-25T02:05:49.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.848 7fc21c3fa700 1 -- start start 2024-04-25T02:05:49.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.848 7fc21c3fa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140f58a0 0x7fc2140f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.848 7fc21c3fa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140f2290 0x7fc21410ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.848 7fc21c3fa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2140f91b0 con 0x7fc2140f1e40 2024-04-25T02:05:49.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.848 7fc21c3fa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21410f060 con 0x7fc2140f2290 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.848 7fc21c3fa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141ac600 con 0x7fc2140f58a0 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2199f6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140f2290 0x7fc21410ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2191f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140f58a0 0x7fc2140f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2191f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140f58a0 0x7fc2140f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60546/0 (socket says 172.21.15.57:60546) 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2199f6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140f2290 0x7fc21410ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49464/0 (socket says 172.21.15.57:49464) 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2191f5700 1 -- 172.21.15.57:0/2455370767 learned_addr learned my addr 172.21.15.57:0/2455370767 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2189f4700 1 --1- 172.21.15.57:0/2455370767 >> v1:172.21.15.57:6789/0 conn(0x7fc2140f1e40 0x7fc21410e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57512/0 (socket says 172.21.15.57:57512) 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2199f6700 1 -- 172.21.15.57:0/2455370767 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140f58a0 msgr2=0x7fc2140f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2199f6700 1 --2- 172.21.15.57:0/2455370767 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140f58a0 0x7fc2140f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2199f6700 1 -- 172.21.15.57:0/2455370767 >> v1:172.21.15.57:6789/0 conn(0x7fc2140f1e40 legacy=0x7fc21410e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc203fff700 1 -- 172.21.15.57:0/2455370767 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176103733 0 0) 0x7fc204001110 con 0x7fc2140f1e40 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2199f6700 1 -- 172.21.15.57:0/2455370767 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2141ac7b0 con 0x7fc2140f2290 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2191f5700 1 --2- 172.21.15.57:0/2455370767 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140f58a0 0x7fc2140f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:49.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc2199f6700 1 --2- 172.21.15.57:0/2455370767 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140f2290 0x7fc21410ea30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc214103770 tx=0x7fc20c009d70).ready entity=mon.1 client_cookie=a1e7283f966cd41e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc203fff700 1 -- 172.21.15.57:0/2455370767 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2141ac7b0 con 0x7fc2140f2290 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc203fff700 1 -- 172.21.15.57:0/2455370767 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00b7c0 con 0x7fc2140f2290 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc203fff700 1 -- 172.21.15.57:0/2455370767 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc20c00b9a0 con 0x7fc2140f2290 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc21c3fa700 1 -- 172.21.15.57:0/2455370767 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140f2290 msgr2=0x7fc21410ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.849 7fc21c3fa700 1 --2- 172.21.15.57:0/2455370767 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140f2290 0x7fc21410ea30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fc214103770 tx=0x7fc20c009d70).stop 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.850 7fc21c3fa700 1 -- 172.21.15.57:0/2455370767 shutdown_connections 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.850 7fc21c3fa700 1 --2- 172.21.15.57:0/2455370767 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140f2290 0x7fc21410ea30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.850 7fc21c3fa700 1 --2- 172.21.15.57:0/2455370767 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140f58a0 0x7fc2140f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.850 7fc21c3fa700 1 -- 172.21.15.57:0/2455370767 >> 172.21.15.57:0/2455370767 conn(0x7fc2141139f0 msgr2=0x7fc2140f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.850 7fc21c3fa700 1 -- 172.21.15.57:0/2455370767 shutdown_connections 2024-04-25T02:05:49.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.850 7fc21c3fa700 1 -- 172.21.15.57:0/2455370767 wait complete. 2024-04-25T02:05:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc21c3fa700 1 Processor -- start 2024-04-25T02:05:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc21c3fa700 1 -- start start 2024-04-25T02:05:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc21c3fa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2140cd1a0 0x7fc2140cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc21c3fa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140cb9f0 0x7fc2141b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc21c3fa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140cbe40 0x7fc2141b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:49.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc21c3fa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140cc730 con 0x7fc2140cd1a0 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc21c3fa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140ccd80 con 0x7fc2140cbe40 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc21c3fa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141b4ec0 con 0x7fc2140cb9f0 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc2189f4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140cb9f0 0x7fc2141b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc2191f5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2140cd1a0 0x7fc2140cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc2199f6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140cbe40 0x7fc2141b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc2189f4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140cb9f0 0x7fc2141b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60548/0 (socket says 172.21.15.57:60548) 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc2191f5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2140cd1a0 0x7fc2140cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57150/0 (socket says 172.21.15.57:57150) 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc2199f6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140cbe40 0x7fc2141b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49468/0 (socket says 172.21.15.57:49468) 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.874 7fc2189f4700 1 -- 172.21.15.57:0/1994639403 learned_addr learned my addr 172.21.15.57:0/1994639403 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2199f6700 1 -- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140cb9f0 msgr2=0x7fc2141b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2199f6700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140cb9f0 0x7fc2141b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2199f6700 1 -- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2140cd1a0 msgr2=0x7fc2140cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2199f6700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2140cd1a0 0x7fc2140cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2199f6700 1 -- 172.21.15.57:0/1994639403 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2141b50a0 con 0x7fc2140cbe40 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2189f4700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140cb9f0 0x7fc2141b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2191f5700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2140cd1a0 0x7fc2140cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2199f6700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140cbe40 0x7fc2141b4890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc20c006fc0 tx=0x7fc20c006c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2027fc700 1 -- 172.21.15.57:0/1994639403 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2141b50a0 con 0x7fc2140cbe40 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2027fc700 1 -- 172.21.15.57:0/1994639403 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c011a70 con 0x7fc2140cbe40 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2141bb9d0 con 0x7fc2140cbe40 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc2027fc700 1 -- 172.21.15.57:0/1994639403 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc20c017040 con 0x7fc2140cbe40 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.875 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2141bbdb0 con 0x7fc2140cbe40 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.876 7fc2027fc700 1 -- 172.21.15.57:0/1994639403 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc20c01c470 con 0x7fc2140cbe40 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.876 7fc2027fc700 1 -- 172.21.15.57:0/1994639403 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc20c018030 con 0x7fc2140cbe40 2024-04-25T02:05:49.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.876 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2140f0860 con 0x7fc2140cbe40 2024-04-25T02:05:49.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.879 7fc2027fc700 1 -- 172.21.15.57:0/1994639403 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc20c011860 con 0x7fc2140cbe40 2024-04-25T02:05:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.991 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2141ae980 con 0x7fc2140cbe40 2024-04-25T02:05:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.992 7fc2027fc700 1 -- 172.21.15.57:0/1994639403 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7fc20c00b5b0 con 0x7fc2140cbe40 2024-04-25T02:05:49.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:49.998 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:48.339447","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 >> v1:172.21.15.57:6816/43033 conn(0x7fc1f40145b0 legacy=0x7fc1f4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140cbe40 msgr2=0x7fc2141b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140cbe40 0x7fc2141b4890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc20c006fc0 tx=0x7fc20c006c40).stop 2024-04-25T02:05:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 shutdown_connections 2024-04-25T02:05:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2140cbe40 0x7fc2141b4890 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2140cd1a0 0x7fc2140cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 --2- 172.21.15.57:0/1994639403 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2140cb9f0 0x7fc2141b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 >> 172.21.15.57:0/1994639403 conn(0x7fc2140dc600 msgr2=0x7fc2140bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:50.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 shutdown_connections 2024-04-25T02:05:50.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:49.993 7fc21c3fa700 1 -- 172.21.15.57:0/1994639403 wait complete. 2024-04-25T02:05:50.010 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:05:50.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:05:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f221a790700 1 Processor -- start 2024-04-25T02:05:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f221a790700 1 -- start start 2024-04-25T02:05:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f221a790700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f221410cb40 0x7f22141a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f221a790700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22141a6be0 0x7f22141a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f221a790700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221410cf90 con 0x7f22140f5920 2024-04-25T02:05:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f221a790700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22140fa290 con 0x7f22141a6be0 2024-04-25T02:05:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f221a790700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22140f95c0 con 0x7f221410cb40 2024-04-25T02:05:50.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2213bb1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22141a6be0 0x7f22141a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2212baf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f221410cb40 0x7f22141a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2213bb1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f22141a6be0 0x7f22141a9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57166/0 (socket says 172.21.15.57:57166) 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2213bb1700 1 -- 172.21.15.57:0/676081943 learned_addr learned my addr 172.21.15.57:0/676081943 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2212baf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f221410cb40 0x7f22141a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60558/0 (socket says 172.21.15.57:60558) 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2213bb1700 1 -- 172.21.15.57:0/676081943 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f221410cb40 msgr2=0x7f22141a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2213bb1700 1 --2- 172.21.15.57:0/676081943 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f221410cb40 0x7f22141a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2213bb1700 1 -- 172.21.15.57:0/676081943 >> v1:172.21.15.57:6789/0 conn(0x7f22140f5920 legacy=0x7f221410c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2213bb1700 1 -- 172.21.15.57:0/676081943 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22141aa680 con 0x7f22141a6be0 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f22123ae700 1 -- 172.21.15.57:0/676081943 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841321302 0 0) 0x7f2204001110 con 0x7f22140f5920 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.136 7f2212baf700 1 --2- 172.21.15.57:0/676081943 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f221410cb40 0x7f22141a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f2213bb1700 1 --2- 172.21.15.57:0/676081943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22141a6be0 0x7f22141a9040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f22140f9770 tx=0x7f220c009e10).ready entity=mon.0 client_cookie=ae84e9def61b77aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f22123ae700 1 -- 172.21.15.57:0/676081943 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f22141aa680 con 0x7f22141a6be0 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f22123ae700 1 -- 172.21.15.57:0/676081943 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c00b890 con 0x7f22141a6be0 2024-04-25T02:05:50.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f22123ae700 1 -- 172.21.15.57:0/676081943 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f220c00ba70 con 0x7f22141a6be0 2024-04-25T02:05:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f221a790700 1 -- 172.21.15.57:0/676081943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22141a6be0 msgr2=0x7f22141a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f221a790700 1 --2- 172.21.15.57:0/676081943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22141a6be0 0x7f22141a9040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f22140f9770 tx=0x7f220c009e10).stop 2024-04-25T02:05:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f221a790700 1 -- 172.21.15.57:0/676081943 shutdown_connections 2024-04-25T02:05:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f221a790700 1 --2- 172.21.15.57:0/676081943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22141a6be0 0x7f22141a9040 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f221a790700 1 --2- 172.21.15.57:0/676081943 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f221410cb40 0x7f22141a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f221a790700 1 -- 172.21.15.57:0/676081943 >> 172.21.15.57:0/676081943 conn(0x7f2214113a70 msgr2=0x7f22140f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f221a790700 1 -- 172.21.15.57:0/676081943 shutdown_connections 2024-04-25T02:05:50.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.137 7f221a790700 1 -- 172.21.15.57:0/676081943 wait complete. 2024-04-25T02:05:50.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.161 7f221a790700 1 Processor -- start 2024-04-25T02:05:50.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.161 7f221a790700 1 -- start start 2024-04-25T02:05:50.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f221a790700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22140cf2c0 0x7f22140cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f221a790700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22140cfd40 0x7f22141b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f221a790700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22141b4d30 0x7f22141b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f221a790700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140f0250 con 0x7f22140cfd40 2024-04-25T02:05:50.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f221a790700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22140d7210 con 0x7f22141b4d30 2024-04-25T02:05:50.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f221a790700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22140c4bf0 con 0x7f22140cf2c0 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f2212baf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22140cfd40 0x7f22141b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f2213bb1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22141b4d30 0x7f22141b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f22133b0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22140cf2c0 0x7f22140cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f2212baf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22140cfd40 0x7f22141b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57182/0 (socket says 172.21.15.57:57182) 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f2212baf700 1 -- 172.21.15.57:0/2226251756 learned_addr learned my addr 172.21.15.57:0/2226251756 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f22133b0700 1 -- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22141b4d30 msgr2=0x7f22141b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f22133b0700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22141b4d30 0x7f22141b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f22133b0700 1 -- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22140cfd40 msgr2=0x7f22141b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f22133b0700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22140cfd40 0x7f22141b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f22133b0700 1 -- 172.21.15.57:0/2226251756 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140d78f0 con 0x7f22140cf2c0 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f2213bb1700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22141b4d30 0x7f22141b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f2212baf700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22140cfd40 0x7f22141b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.162 7f22133b0700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22140cf2c0 0x7f22140cf710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f22141b11b0 tx=0x7f220400c7c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:50.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.163 7f2210bab700 1 -- 172.21.15.57:0/2226251756 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f22140d78f0 con 0x7f22140cf2c0 2024-04-25T02:05:50.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.163 7f2210bab700 1 -- 172.21.15.57:0/2226251756 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204007030 con 0x7f22140cf2c0 2024-04-25T02:05:50.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.163 7f221a790700 1 -- 172.21.15.57:0/2226251756 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22140d42b0 con 0x7f22140cf2c0 2024-04-25T02:05:50.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.163 7f2210bab700 1 -- 172.21.15.57:0/2226251756 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2204006520 con 0x7f22140cf2c0 2024-04-25T02:05:50.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.163 7f221a790700 1 -- 172.21.15.57:0/2226251756 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22141bbe80 con 0x7f22140cf2c0 2024-04-25T02:05:50.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.163 7f2210bab700 1 -- 172.21.15.57:0/2226251756 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f220401a020 con 0x7f22140cf2c0 2024-04-25T02:05:50.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.163 7f2210bab700 1 -- 172.21.15.57:0/2226251756 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f2204003c20 con 0x7f22140cf2c0 2024-04-25T02:05:50.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.164 7f221a790700 1 -- 172.21.15.57:0/2226251756 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22140f08e0 con 0x7f22140cf2c0 2024-04-25T02:05:50.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.167 7f2210bab700 1 -- 172.21.15.57:0/2226251756 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f2204007db0 con 0x7f22140cf2c0 2024-04-25T02:05:50.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.272 7f221a790700 1 -- 172.21.15.57:0/2226251756 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f2214087810 con 0x7f21f80145b0 2024-04-25T02:05:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.281 7f2210bab700 1 -- 172.21.15.57:0/2226251756 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299750 (unknown 2965378022 0 3039200426) 0x7f21fc00bac0 con 0x7f21f80145b0 2024-04-25T02:05:50.291 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:50.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.283 7f221a790700 1 -- 172.21.15.57:0/2226251756 >> v1:172.21.15.57:6816/43033 conn(0x7f21f80145b0 legacy=0x7f21f8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.283 7f221a790700 1 -- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22140cf2c0 msgr2=0x7f22140cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.283 7f221a790700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22140cf2c0 0x7f22140cf710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f22141b11b0 tx=0x7f220400c7c0).stop 2024-04-25T02:05:50.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.283 7f221a790700 1 -- 172.21.15.57:0/2226251756 shutdown_connections 2024-04-25T02:05:50.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.283 7f221a790700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22141b4d30 0x7f22141b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.283 7f221a790700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22140cf2c0 0x7f22140cf710 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.283 7f221a790700 1 --2- 172.21.15.57:0/2226251756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22140cfd40 0x7f22141b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.283 7f221a790700 1 -- 172.21.15.57:0/2226251756 >> 172.21.15.57:0/2226251756 conn(0x7f22140ca3b0 msgr2=0x7f22141a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:50.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.284 7f221a790700 1 -- 172.21.15.57:0/2226251756 shutdown_connections 2024-04-25T02:05:50.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.284 7f221a790700 1 -- 172.21.15.57:0/2226251756 wait complete. 2024-04-25T02:05:50.294 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:05:50.300 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-25 02:05:48.665816","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194752,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292608,"statfs":{"total":386547056640,"available":382251630592,"internally_reserved":4294967296,"allocated":425984,"data_stored":97524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.746250","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:05:38.746250","last_peered":"2024-04-25 02:05:38.746250","last_clean":"2024-04-25 02:05:38.746250","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:05:38.746250","last_undegraded":"2024-04-25 02:05:38.746250","last_fullsized":"2024-04-25 02:05:38.746250","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.746758","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:05:38.746758","last_peered":"2024-04-25 02:05:38.746758","last_clean":"2024-04-25 02:05:38.746758","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:05:38.746758","last_undegraded":"2024-04-25 02:05:38.746758","last_fullsized":"2024-04-25 02:05:38.746758","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.746297","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:05:38.746297","last_peered":"2024-04-25 02:05:38.746297","last_clean":"2024-04-25 02:05:38.746297","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:05:38.746297","last_undegraded":"2024-04-25 02:05:38.746297","last_fullsized":"2024-04-25 02:05:38.746297","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.744919","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:05:38.744919","last_peered":"2024-04-25 02:05:38.744919","last_clean":"2024-04-25 02:05:38.744919","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:05:38.744919","last_undegraded":"2024-04-25 02:05:38.744919","last_fullsized":"2024-04-25 02:05:38.744919","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.744349","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:05:38.744349","last_peered":"2024-04-25 02:05:38.744349","last_clean":"2024-04-25 02:05:38.744349","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:05:38.744349","last_undegraded":"2024-04-25 02:05:38.744349","last_fullsized":"2024-04-25 02:05:38.744349","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.744543","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:05:38.744543","last_peered":"2024-04-25 02:05:38.744543","last_clean":"2024-04-25 02:05:38.744543","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:05:38.744543","last_undegraded":"2024-04-25 02:05:38.744543","last_fullsized":"2024-04-25 02:05:38.744543","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.746740","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:05:38.746740","last_peered":"2024-04-25 02:05:38.746740","last_clean":"2024-04-25 02:05:38.746740","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:05:38.746740","last_undegraded":"2024-04-25 02:05:38.746740","last_fullsized":"2024-04-25 02:05:38.746740","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.744438","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:05:38.744438","last_peered":"2024-04-25 02:05:38.744438","last_clean":"2024-04-25 02:05:38.744438","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:05:38.744438","last_undegraded":"2024-04-25 02:05:38.744438","last_fullsized":"2024-04-25 02:05:38.744438","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]}]}} 2024-04-25T02:05:50.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.467 7fa8708ac700 1 Processor -- start 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.467 7fa8708ac700 1 -- start start 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.467 7fa8708ac700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c10ec60 0x7fa86c1a8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.467 7fa8708ac700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c1a8dc0 0x7fa86c1ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.467 7fa8708ac700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86c10f0b0 con 0x7fa86c106530 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.467 7fa8708ac700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0fb670 con 0x7fa86c10ec60 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.467 7fa8708ac700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c106980 con 0x7fa86c1a8dc0 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa868dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c10ec60 0x7fa86c1a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa869dfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c1a8dc0 0x7fa86c1ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa8695fb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa86c106530 0x7fa86c10e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57526/0 (socket says 172.21.15.57:57526) 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa8695fb700 1 -- 172.21.15.57:0/4221762020 learned_addr learned my addr 172.21.15.57:0/4221762020 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa868dfa700 1 -- 172.21.15.57:0/4221762020 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c1a8dc0 msgr2=0x7fa86c1ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa868dfa700 1 --2- 172.21.15.57:0/4221762020 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c1a8dc0 0x7fa86c1ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa868dfa700 1 -- 172.21.15.57:0/4221762020 >> v1:172.21.15.57:6789/0 conn(0x7fa86c106530 legacy=0x7fa86c10e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa868dfa700 1 -- 172.21.15.57:0/4221762020 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c1ac860 con 0x7fa86c10ec60 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa863fff700 1 -- 172.21.15.57:0/4221762020 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821784675 0 0) 0x7fa85c001110 con 0x7fa86c106530 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa868dfa700 1 --2- 172.21.15.57:0/4221762020 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c10ec60 0x7fa86c1a8790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa86c0fb820 tx=0x7fa85400ba50).ready entity=mon.1 client_cookie=8b97a8fdf5532e27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa863fff700 1 -- 172.21.15.57:0/4221762020 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa86c1ac860 con 0x7fa86c10ec60 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa863fff700 1 -- 172.21.15.57:0/4221762020 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85400d570 con 0x7fa86c10ec60 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa863fff700 1 -- 172.21.15.57:0/4221762020 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa85400d940 con 0x7fa86c10ec60 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa8708ac700 1 -- 172.21.15.57:0/4221762020 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c10ec60 msgr2=0x7fa86c1a8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.468 7fa8708ac700 1 --2- 172.21.15.57:0/4221762020 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c10ec60 0x7fa86c1a8790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa86c0fb820 tx=0x7fa85400ba50).stop 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.469 7fa8708ac700 1 -- 172.21.15.57:0/4221762020 shutdown_connections 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.469 7fa8708ac700 1 --2- 172.21.15.57:0/4221762020 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c1a8dc0 0x7fa86c1ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.469 7fa8708ac700 1 --2- 172.21.15.57:0/4221762020 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c10ec60 0x7fa86c1a8790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.469 7fa8708ac700 1 -- 172.21.15.57:0/4221762020 >> 172.21.15.57:0/4221762020 conn(0x7fa86c114940 msgr2=0x7fa86c114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:50.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.469 7fa8708ac700 1 -- 172.21.15.57:0/4221762020 shutdown_connections 2024-04-25T02:05:50.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.469 7fa8708ac700 1 -- 172.21.15.57:0/4221762020 wait complete. 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8708ac700 1 Processor -- start 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8708ac700 1 -- start start 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8708ac700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c0d5490 0x7fa86c0d58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8708ac700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c0d5f10 0x7fa86c1b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8708ac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa86c1b4c10 0x7fa86c1b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8708ac700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0dc920 con 0x7fa86c1b4c10 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8708ac700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0c49f0 con 0x7fa86c0d5490 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8708ac700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0dcc70 con 0x7fa86c0d5f10 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa868dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c0d5f10 0x7fa86c1b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa869dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa86c1b4c10 0x7fa86c1b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa8695fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c0d5490 0x7fa86c0d58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa868dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c0d5f10 0x7fa86c1b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60586/0 (socket says 172.21.15.57:60586) 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa869dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa86c1b4c10 0x7fa86c1b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57198/0 (socket says 172.21.15.57:57198) 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.493 7fa868dfa700 1 -- 172.21.15.57:0/2857083162 learned_addr learned my addr 172.21.15.57:0/2857083162 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8695fb700 1 -- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c0d5f10 msgr2=0x7fa86c1b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8695fb700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c0d5f10 0x7fa86c1b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8695fb700 1 -- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa86c1b4c10 msgr2=0x7fa86c1b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8695fb700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa86c1b4c10 0x7fa86c1b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8695fb700 1 -- 172.21.15.57:0/2857083162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c0cec70 con 0x7fa86c0d5490 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa868dfa700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c0d5f10 0x7fa86c1b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa869dfc700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa86c1b4c10 0x7fa86c1b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8695fb700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c0d5490 0x7fa86c0d58e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa86c0c5b20 tx=0x7fa85c00c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8627fc700 1 -- 172.21.15.57:0/2857083162 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa86c0cec70 con 0x7fa86c0d5490 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8627fc700 1 -- 172.21.15.57:0/2857083162 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c0070d0 con 0x7fa86c0d5490 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86c0dd420 con 0x7fa86c0d5490 2024-04-25T02:05:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8627fc700 1 -- 172.21.15.57:0/2857083162 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa85c005620 con 0x7fa86c0d5490 2024-04-25T02:05:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86c1bbd50 con 0x7fa86c0d5490 2024-04-25T02:05:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.494 7fa8627fc700 1 -- 172.21.15.57:0/2857083162 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa85c005820 con 0x7fa86c0d5490 2024-04-25T02:05:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.495 7fa8627fc700 1 -- 172.21.15.57:0/2857083162 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa85c010760 con 0x7fa86c0d5490 2024-04-25T02:05:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.495 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86c0f08e0 con 0x7fa86c0d5490 2024-04-25T02:05:50.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.498 7fa8627fc700 1 -- 172.21.15.57:0/2857083162 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa85c00cdd0 con 0x7fa86c0d5490 2024-04-25T02:05:50.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.605 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fa86c087810 con 0x7fa8500145b0 2024-04-25T02:05:50.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.612 7fa8627fc700 1 -- 172.21.15.57:0/2857083162 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299750 (unknown 2965378022 0 3039200426) 0x7fa854006950 con 0x7fa8500145b0 2024-04-25T02:05:50.622 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:50.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 >> v1:172.21.15.57:6816/43033 conn(0x7fa8500145b0 legacy=0x7fa850016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c0d5490 msgr2=0x7fa86c0d58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c0d5490 0x7fa86c0d58e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa86c0c5b20 tx=0x7fa85c00c860).stop 2024-04-25T02:05:50.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 shutdown_connections 2024-04-25T02:05:50.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa86c1b4c10 0x7fa86c1b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa86c0d5490 0x7fa86c0d58e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 --2- 172.21.15.57:0/2857083162 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa86c0d5f10 0x7fa86c1b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 >> 172.21.15.57:0/2857083162 conn(0x7fa86c0cf990 msgr2=0x7fa86c1a85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 shutdown_connections 2024-04-25T02:05:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.615 7fa8708ac700 1 -- 172.21.15.57:0/2857083162 wait complete. 2024-04-25T02:05:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:05:50.632 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-25 02:05:48.665816","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194752,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292608,"statfs":{"total":386547056640,"available":382251630592,"internally_reserved":4294967296,"allocated":425984,"data_stored":97524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.746250","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:05:38.746250","last_peered":"2024-04-25 02:05:38.746250","last_clean":"2024-04-25 02:05:38.746250","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:05:38.746250","last_undegraded":"2024-04-25 02:05:38.746250","last_fullsized":"2024-04-25 02:05:38.746250","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.746758","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:05:38.746758","last_peered":"2024-04-25 02:05:38.746758","last_clean":"2024-04-25 02:05:38.746758","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:05:38.746758","last_undegraded":"2024-04-25 02:05:38.746758","last_fullsized":"2024-04-25 02:05:38.746758","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.746297","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:05:38.746297","last_peered":"2024-04-25 02:05:38.746297","last_clean":"2024-04-25 02:05:38.746297","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:05:38.746297","last_undegraded":"2024-04-25 02:05:38.746297","last_fullsized":"2024-04-25 02:05:38.746297","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.744919","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:05:38.744919","last_peered":"2024-04-25 02:05:38.744919","last_clean":"2024-04-25 02:05:38.744919","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:05:38.744919","last_undegraded":"2024-04-25 02:05:38.744919","last_fullsized":"2024-04-25 02:05:38.744919","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.744349","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:05:38.744349","last_peered":"2024-04-25 02:05:38.744349","last_clean":"2024-04-25 02:05:38.744349","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:05:38.744349","last_undegraded":"2024-04-25 02:05:38.744349","last_fullsized":"2024-04-25 02:05:38.744349","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.744543","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:05:38.744543","last_peered":"2024-04-25 02:05:38.744543","last_clean":"2024-04-25 02:05:38.744543","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:05:38.744543","last_undegraded":"2024-04-25 02:05:38.744543","last_fullsized":"2024-04-25 02:05:38.744543","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.746740","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:05:38.746740","last_peered":"2024-04-25 02:05:38.746740","last_clean":"2024-04-25 02:05:38.746740","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:05:38.746740","last_undegraded":"2024-04-25 02:05:38.746740","last_fullsized":"2024-04-25 02:05:38.746740","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2024-04-25 02:05:38.744438","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:05:38.744438","last_peered":"2024-04-25 02:05:38.744438","last_clean":"2024-04-25 02:05:38.744438","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:05:38.744438","last_undegraded":"2024-04-25 02:05:38.744438","last_fullsized":"2024-04-25 02:05:38.744438","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:46.957580","last_change":"2024-04-25 02:05:46.957580","last_active":"2024-04-25 02:05:46.957580","last_peered":"2024-04-25 02:05:46.957580","last_clean":"2024-04-25 02:05:46.957580","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:46.957580","last_undegraded":"2024-04-25 02:05:46.957580","last_fullsized":"2024-04-25 02:05:46.957580","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:05:45.951812","last_change":"2024-04-25 02:05:45.951812","last_active":"2024-04-25 02:05:45.951812","last_peered":"2024-04-25 02:05:45.951812","last_clean":"2024-04-25 02:05:45.951812","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:05:45.951812","last_undegraded":"2024-04-25 02:05:45.951812","last_fullsized":"2024-04-25 02:05:45.951812","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":24381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]}]}} 2024-04-25T02:05:50.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:05:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.798 7f5ecc933700 1 Processor -- start 2024-04-25T02:05:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.798 7f5ecc933700 1 -- start start 2024-04-25T02:05:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ecc933700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ec80f5a10 0x7f5ec810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ecc933700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec810bb90 0x7f5ec81a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ecc933700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec81a0a70 con 0x7f5ec810b740 2024-04-25T02:05:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ecc933700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec80fa590 con 0x7f5ec80f5a10 2024-04-25T02:05:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ecc933700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec81a0c90 con 0x7f5ec810bb90 2024-04-25T02:05:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec5dfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec810bb90 0x7f5ec81a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec55fb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ec80f5a10 0x7f5ec810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec55fb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ec80f5a10 0x7f5ec810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57204/0 (socket says 172.21.15.57:57204) 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec5dfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec810bb90 0x7f5ec81a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60598/0 (socket says 172.21.15.57:60598) 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec4dfa700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5ec810b740 0x7f5ec819fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57532/0 (socket says 172.21.15.57:57532) 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec55fb700 1 -- 172.21.15.57:0/3582091720 learned_addr learned my addr 172.21.15.57:0/3582091720 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec55fb700 1 -- 172.21.15.57:0/3582091720 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec810bb90 msgr2=0x7f5ec81a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec55fb700 1 --2- 172.21.15.57:0/3582091720 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec810bb90 0x7f5ec81a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec55fb700 1 -- 172.21.15.57:0/3582091720 >> v1:172.21.15.57:6789/0 conn(0x7f5ec810b740 legacy=0x7f5ec819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec55fb700 1 -- 172.21.15.57:0/3582091720 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec81a93d0 con 0x7f5ec80f5a10 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ebffff700 1 -- 172.21.15.57:0/3582091720 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068372070 0 0) 0x7f5eb0001110 con 0x7f5ec810b740 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec5dfc700 1 --2- 172.21.15.57:0/3582091720 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec810bb90 0x7f5ec81a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ec55fb700 1 --2- 172.21.15.57:0/3582091720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80f5a10 0x7f5ec810b110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5ec8103a10 tx=0x7f5eb8009a80).ready entity=mon.0 client_cookie=75051faf72b3b782 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ebffff700 1 -- 172.21.15.57:0/3582091720 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ec81a93d0 con 0x7f5ec80f5a10 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ebffff700 1 -- 172.21.15.57:0/3582091720 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800f510 con 0x7f5ec80f5a10 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ebffff700 1 -- 172.21.15.57:0/3582091720 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5eb800f6f0 con 0x7f5ec80f5a10 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ecc933700 1 -- 172.21.15.57:0/3582091720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80f5a10 msgr2=0x7f5ec810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.799 7f5ecc933700 1 --2- 172.21.15.57:0/3582091720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80f5a10 0x7f5ec810b110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5ec8103a10 tx=0x7f5eb8009a80).stop 2024-04-25T02:05:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.800 7f5ecc933700 1 -- 172.21.15.57:0/3582091720 shutdown_connections 2024-04-25T02:05:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.800 7f5ecc933700 1 --2- 172.21.15.57:0/3582091720 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec810bb90 0x7f5ec81a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.800 7f5ecc933700 1 --2- 172.21.15.57:0/3582091720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80f5a10 0x7f5ec810b110 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.800 7f5ecc933700 1 -- 172.21.15.57:0/3582091720 >> 172.21.15.57:0/3582091720 conn(0x7f5ec8113a70 msgr2=0x7f5ec80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.800 7f5ecc933700 1 -- 172.21.15.57:0/3582091720 shutdown_connections 2024-04-25T02:05:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.800 7f5ecc933700 1 -- 172.21.15.57:0/3582091720 wait complete. 2024-04-25T02:05:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.824 7f5ecc933700 1 Processor -- start 2024-04-25T02:05:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.824 7f5ecc933700 1 -- start start 2024-04-25T02:05:50.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ecc933700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec80cd3e0 0x7f5ec80cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ecc933700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80cde60 0x7f5ec81b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ecc933700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec81b2f50 0x7f5ec81b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ecc933700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80f0570 con 0x7f5ec80cde60 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ecc933700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80bb820 con 0x7f5ec81b2f50 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ecc933700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80c2b30 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec4dfa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80cde60 0x7f5ec81b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec55fb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec80cd3e0 0x7f5ec80cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec5dfc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec81b2f50 0x7f5ec81b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec55fb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec80cd3e0 0x7f5ec80cd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60608/0 (socket says 172.21.15.57:60608) 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec4dfa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80cde60 0x7f5ec81b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57218/0 (socket says 172.21.15.57:57218) 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec55fb700 1 -- 172.21.15.57:0/4044090063 learned_addr learned my addr 172.21.15.57:0/4044090063 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec55fb700 1 -- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec81b2f50 msgr2=0x7f5ec81b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec55fb700 1 --2- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec81b2f50 0x7f5ec81b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec55fb700 1 -- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80cde60 msgr2=0x7f5ec81b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec55fb700 1 --2- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80cde60 0x7f5ec81b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec55fb700 1 -- 172.21.15.57:0/4044090063 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec80deac0 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.825 7f5ec4dfa700 1 --2- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80cde60 0x7f5ec81b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.826 7f5ec55fb700 1 --2- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec80cd3e0 0x7f5ec80cd830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5ec80e0d90 tx=0x7f5eb80068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.826 7f5ebe7fc700 1 -- 172.21.15.57:0/4044090063 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ec80deac0 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.826 7f5ebe7fc700 1 -- 172.21.15.57:0/4044090063 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb80119a0 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.826 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec81b9fb0 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.826 7f5ebe7fc700 1 -- 172.21.15.57:0/4044090063 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5eb8011d70 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.826 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec81ba1b0 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.826 7f5ebe7fc700 1 -- 172.21.15.57:0/4044090063 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5eb8019030 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.826 7f5ebe7fc700 1 -- 172.21.15.57:0/4044090063 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5eb8018040 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.827 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec80a61a0 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.830 7f5ebe7fc700 1 -- 172.21.15.57:0/4044090063 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5eb800f300 con 0x7f5ec80cd3e0 2024-04-25T02:05:50.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.937 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f5ec8087810 con 0x7f5eac0145b0 2024-04-25T02:05:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.945 7f5ebe7fc700 1 -- 172.21.15.57:0/4044090063 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306153 (unknown 2965378022 0 2488207424) 0x7f5eb00015e0 con 0x7f5eac0145b0 2024-04-25T02:05:50.955 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 >> v1:172.21.15.57:6816/43033 conn(0x7f5eac0145b0 legacy=0x7f5eac016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec80cd3e0 msgr2=0x7f5ec80cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 --2- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec80cd3e0 0x7f5ec80cd830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5ec80e0d90 tx=0x7f5eb80068c0).stop 2024-04-25T02:05:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 shutdown_connections 2024-04-25T02:05:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 --2- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec81b2f50 0x7f5ec81b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 --2- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ec80cd3e0 0x7f5ec80cd830 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 --2- 172.21.15.57:0/4044090063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec80cde60 0x7f5ec81b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:50.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 >> 172.21.15.57:0/4044090063 conn(0x7f5ec80e10a0 msgr2=0x7f5ec80d7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:50.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 shutdown_connections 2024-04-25T02:05:50.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:50.947 7f5ecc933700 1 -- 172.21.15.57:0/4044090063 wait complete. 2024-04-25T02:05:50.958 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:05:50.964 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25 02:05:50.666127","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372976","last_change":"2024-04-25 02:05:47.369320","last_active":"2024-04-25 02:05:47.372976","last_peered":"2024-04-25 02:05:47.372976","last_clean":"2024-04-25 02:05:47.372976","last_became_active":"2024-04-25 02:05:47.369008","last_became_peered":"2024-04-25 02:05:47.369008","last_unstale":"2024-04-25 02:05:47.372976","last_undegraded":"2024-04-25 02:05:47.372976","last_fullsized":"2024-04-25 02:05:47.372976","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358525","last_change":"2024-04-25 02:05:47.021686","last_active":"2024-04-25 02:05:47.358525","last_peered":"2024-04-25 02:05:47.358525","last_clean":"2024-04-25 02:05:47.358525","last_became_active":"2024-04-25 02:05:47.020938","last_became_peered":"2024-04-25 02:05:47.020938","last_unstale":"2024-04-25 02:05:47.358525","last_undegraded":"2024-04-25 02:05:47.358525","last_fullsized":"2024-04-25 02:05:47.358525","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388999","last_change":"2024-04-25 02:05:47.384312","last_active":"2024-04-25 02:05:47.388999","last_peered":"2024-04-25 02:05:47.388999","last_clean":"2024-04-25 02:05:47.388999","last_became_active":"2024-04-25 02:05:47.378585","last_became_peered":"2024-04-25 02:05:47.378585","last_unstale":"2024-04-25 02:05:47.388999","last_undegraded":"2024-04-25 02:05:47.388999","last_fullsized":"2024-04-25 02:05:47.388999","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363658","last_change":"2024-04-25 02:05:47.020533","last_active":"2024-04-25 02:05:47.363658","last_peered":"2024-04-25 02:05:47.363658","last_clean":"2024-04-25 02:05:47.363658","last_became_active":"2024-04-25 02:05:47.019990","last_became_peered":"2024-04-25 02:05:47.019990","last_unstale":"2024-04-25 02:05:47.363658","last_undegraded":"2024-04-25 02:05:47.363658","last_fullsized":"2024-04-25 02:05:47.363658","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388734","last_change":"2024-04-25 02:05:47.379801","last_active":"2024-04-25 02:05:47.388734","last_peered":"2024-04-25 02:05:47.388734","last_clean":"2024-04-25 02:05:47.388734","last_became_active":"2024-04-25 02:05:47.379321","last_became_peered":"2024-04-25 02:05:47.379321","last_unstale":"2024-04-25 02:05:47.388734","last_undegraded":"2024-04-25 02:05:47.388734","last_fullsized":"2024-04-25 02:05:47.388734","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357766","last_change":"2024-04-25 02:05:47.020828","last_active":"2024-04-25 02:05:47.357766","last_peered":"2024-04-25 02:05:47.357766","last_clean":"2024-04-25 02:05:47.357766","last_became_active":"2024-04-25 02:05:47.020320","last_became_peered":"2024-04-25 02:05:47.020320","last_unstale":"2024-04-25 02:05:47.357766","last_undegraded":"2024-04-25 02:05:47.357766","last_fullsized":"2024-04-25 02:05:47.357766","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373126","last_change":"2024-04-25 02:05:47.365068","last_active":"2024-04-25 02:05:47.373126","last_peered":"2024-04-25 02:05:47.373126","last_clean":"2024-04-25 02:05:47.373126","last_became_active":"2024-04-25 02:05:47.364768","last_became_peered":"2024-04-25 02:05:47.364768","last_unstale":"2024-04-25 02:05:47.373126","last_undegraded":"2024-04-25 02:05:47.373126","last_fullsized":"2024-04-25 02:05:47.373126","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.355780","last_change":"2024-04-25 02:05:47.028823","last_active":"2024-04-25 02:05:47.355780","last_peered":"2024-04-25 02:05:47.355780","last_clean":"2024-04-25 02:05:47.355780","last_became_active":"2024-04-25 02:05:47.027770","last_became_peered":"2024-04-25 02:05:47.027770","last_unstale":"2024-04-25 02:05:47.355780","last_undegraded":"2024-04-25 02:05:47.355780","last_fullsized":"2024-04-25 02:05:47.355780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382006","last_change":"2024-04-25 02:05:47.377307","last_active":"2024-04-25 02:05:47.382006","last_peered":"2024-04-25 02:05:47.382006","last_clean":"2024-04-25 02:05:47.382006","last_became_active":"2024-04-25 02:05:47.376546","last_became_peered":"2024-04-25 02:05:47.376546","last_unstale":"2024-04-25 02:05:47.382006","last_undegraded":"2024-04-25 02:05:47.382006","last_fullsized":"2024-04-25 02:05:47.382006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353187","last_change":"2024-04-25 02:05:46.996093","last_active":"2024-04-25 02:05:47.353187","last_peered":"2024-04-25 02:05:47.353187","last_clean":"2024-04-25 02:05:47.353187","last_became_active":"2024-04-25 02:05:46.995769","last_became_peered":"2024-04-25 02:05:46.995769","last_unstale":"2024-04-25 02:05:47.353187","last_undegraded":"2024-04-25 02:05:47.353187","last_fullsized":"2024-04-25 02:05:47.353187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390769","last_change":"2024-04-25 02:05:47.385883","last_active":"2024-04-25 02:05:47.390769","last_peered":"2024-04-25 02:05:47.390769","last_clean":"2024-04-25 02:05:47.390769","last_became_active":"2024-04-25 02:05:47.385568","last_became_peered":"2024-04-25 02:05:47.385568","last_unstale":"2024-04-25 02:05:47.390769","last_undegraded":"2024-04-25 02:05:47.390769","last_fullsized":"2024-04-25 02:05:47.390769","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362579","last_change":"2024-04-25 02:05:47.006764","last_active":"2024-04-25 02:05:47.362579","last_peered":"2024-04-25 02:05:47.362579","last_clean":"2024-04-25 02:05:47.362579","last_became_active":"2024-04-25 02:05:47.006519","last_became_peered":"2024-04-25 02:05:47.006519","last_unstale":"2024-04-25 02:05:47.362579","last_undegraded":"2024-04-25 02:05:47.362579","last_fullsized":"2024-04-25 02:05:47.362579","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391008","last_change":"2024-04-25 02:05:47.385392","last_active":"2024-04-25 02:05:47.391008","last_peered":"2024-04-25 02:05:47.391008","last_clean":"2024-04-25 02:05:47.391008","last_became_active":"2024-04-25 02:05:47.385092","last_became_peered":"2024-04-25 02:05:47.385092","last_unstale":"2024-04-25 02:05:47.391008","last_undegraded":"2024-04-25 02:05:47.391008","last_fullsized":"2024-04-25 02:05:47.391008","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387246","last_change":"2024-04-25 02:05:47.003242","last_active":"2024-04-25 02:05:47.387246","last_peered":"2024-04-25 02:05:47.387246","last_clean":"2024-04-25 02:05:47.387246","last_became_active":"2024-04-25 02:05:47.002466","last_became_peered":"2024-04-25 02:05:47.002466","last_unstale":"2024-04-25 02:05:47.387246","last_undegraded":"2024-04-25 02:05:47.387246","last_fullsized":"2024-04-25 02:05:47.387246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390926","last_change":"2024-04-25 02:05:47.387162","last_active":"2024-04-25 02:05:47.390926","last_peered":"2024-04-25 02:05:47.390926","last_clean":"2024-04-25 02:05:47.390926","last_became_active":"2024-04-25 02:05:47.386846","last_became_peered":"2024-04-25 02:05:47.386846","last_unstale":"2024-04-25 02:05:47.390926","last_undegraded":"2024-04-25 02:05:47.390926","last_fullsized":"2024-04-25 02:05:47.390926","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390398","last_change":"2024-04-25 02:05:47.012882","last_active":"2024-04-25 02:05:47.390398","last_peered":"2024-04-25 02:05:47.390398","last_clean":"2024-04-25 02:05:47.390398","last_became_active":"2024-04-25 02:05:47.012356","last_became_peered":"2024-04-25 02:05:47.012356","last_unstale":"2024-04-25 02:05:47.390398","last_undegraded":"2024-04-25 02:05:47.390398","last_fullsized":"2024-04-25 02:05:47.390398","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.381620","last_change":"2024-04-25 02:05:47.376840","last_active":"2024-04-25 02:05:47.381620","last_peered":"2024-04-25 02:05:47.381620","last_clean":"2024-04-25 02:05:47.381620","last_became_active":"2024-04-25 02:05:47.376550","last_became_peered":"2024-04-25 02:05:47.376550","last_unstale":"2024-04-25 02:05:47.381620","last_undegraded":"2024-04-25 02:05:47.381620","last_fullsized":"2024-04-25 02:05:47.381620","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390373","last_change":"2024-04-25 02:05:47.013902","last_active":"2024-04-25 02:05:47.390373","last_peered":"2024-04-25 02:05:47.390373","last_clean":"2024-04-25 02:05:47.390373","last_became_active":"2024-04-25 02:05:47.013571","last_became_peered":"2024-04-25 02:05:47.013571","last_unstale":"2024-04-25 02:05:47.390373","last_undegraded":"2024-04-25 02:05:47.390373","last_fullsized":"2024-04-25 02:05:47.390373","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391228","last_change":"2024-04-25 02:05:47.388939","last_active":"2024-04-25 02:05:47.391228","last_peered":"2024-04-25 02:05:47.391228","last_clean":"2024-04-25 02:05:47.391228","last_became_active":"2024-04-25 02:05:47.388673","last_became_peered":"2024-04-25 02:05:47.388673","last_unstale":"2024-04-25 02:05:47.391228","last_undegraded":"2024-04-25 02:05:47.391228","last_fullsized":"2024-04-25 02:05:47.391228","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363555","last_change":"2024-04-25 02:05:47.016797","last_active":"2024-04-25 02:05:47.363555","last_peered":"2024-04-25 02:05:47.363555","last_clean":"2024-04-25 02:05:47.363555","last_became_active":"2024-04-25 02:05:47.016484","last_became_peered":"2024-04-25 02:05:47.016484","last_unstale":"2024-04-25 02:05:47.363555","last_undegraded":"2024-04-25 02:05:47.363555","last_fullsized":"2024-04-25 02:05:47.363555","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373750","last_change":"2024-04-25 02:05:47.363022","last_active":"2024-04-25 02:05:47.373750","last_peered":"2024-04-25 02:05:47.373750","last_clean":"2024-04-25 02:05:47.373750","last_became_active":"2024-04-25 02:05:47.362681","last_became_peered":"2024-04-25 02:05:47.362681","last_unstale":"2024-04-25 02:05:47.373750","last_undegraded":"2024-04-25 02:05:47.373750","last_fullsized":"2024-04-25 02:05:47.373750","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360184","last_change":"2024-04-25 02:05:47.012986","last_active":"2024-04-25 02:05:47.360184","last_peered":"2024-04-25 02:05:47.360184","last_clean":"2024-04-25 02:05:47.360184","last_became_active":"2024-04-25 02:05:47.012673","last_became_peered":"2024-04-25 02:05:47.012673","last_unstale":"2024-04-25 02:05:47.360184","last_undegraded":"2024-04-25 02:05:47.360184","last_fullsized":"2024-04-25 02:05:47.360184","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388639","last_change":"2024-04-25 02:05:47.378766","last_active":"2024-04-25 02:05:47.388639","last_peered":"2024-04-25 02:05:47.388639","last_clean":"2024-04-25 02:05:47.388639","last_became_active":"2024-04-25 02:05:47.376368","last_became_peered":"2024-04-25 02:05:47.376368","last_unstale":"2024-04-25 02:05:47.388639","last_undegraded":"2024-04-25 02:05:47.388639","last_fullsized":"2024-04-25 02:05:47.388639","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386504","last_change":"2024-04-25 02:05:47.003903","last_active":"2024-04-25 02:05:47.386504","last_peered":"2024-04-25 02:05:47.386504","last_clean":"2024-04-25 02:05:47.386504","last_became_active":"2024-04-25 02:05:47.003584","last_became_peered":"2024-04-25 02:05:47.003584","last_unstale":"2024-04-25 02:05:47.386504","last_undegraded":"2024-04-25 02:05:47.386504","last_fullsized":"2024-04-25 02:05:47.386504","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391545","last_change":"2024-04-25 02:05:47.382468","last_active":"2024-04-25 02:05:47.391545","last_peered":"2024-04-25 02:05:47.391545","last_clean":"2024-04-25 02:05:47.391545","last_became_active":"2024-04-25 02:05:47.382161","last_became_peered":"2024-04-25 02:05:47.382161","last_unstale":"2024-04-25 02:05:47.391545","last_undegraded":"2024-04-25 02:05:47.391545","last_fullsized":"2024-04-25 02:05:47.391545","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380007","last_change":"2024-04-25 02:05:47.014185","last_active":"2024-04-25 02:05:47.380007","last_peered":"2024-04-25 02:05:47.380007","last_clean":"2024-04-25 02:05:47.380007","last_became_active":"2024-04-25 02:05:47.013874","last_became_peered":"2024-04-25 02:05:47.013874","last_unstale":"2024-04-25 02:05:47.380007","last_undegraded":"2024-04-25 02:05:47.380007","last_fullsized":"2024-04-25 02:05:47.380007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383613","last_change":"2024-04-25 02:05:47.375244","last_active":"2024-04-25 02:05:47.383613","last_peered":"2024-04-25 02:05:47.383613","last_clean":"2024-04-25 02:05:47.383613","last_became_active":"2024-04-25 02:05:47.374904","last_became_peered":"2024-04-25 02:05:47.374904","last_unstale":"2024-04-25 02:05:47.383613","last_undegraded":"2024-04-25 02:05:47.383613","last_fullsized":"2024-04-25 02:05:47.383613","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391628","last_change":"2024-04-25 02:05:47.013961","last_active":"2024-04-25 02:05:47.391628","last_peered":"2024-04-25 02:05:47.391628","last_clean":"2024-04-25 02:05:47.391628","last_became_active":"2024-04-25 02:05:47.013634","last_became_peered":"2024-04-25 02:05:47.013634","last_unstale":"2024-04-25 02:05:47.391628","last_undegraded":"2024-04-25 02:05:47.391628","last_fullsized":"2024-04-25 02:05:47.391628","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387497","last_change":"2024-04-25 02:05:47.380961","last_active":"2024-04-25 02:05:47.387497","last_peered":"2024-04-25 02:05:47.387497","last_clean":"2024-04-25 02:05:47.387497","last_became_active":"2024-04-25 02:05:47.380213","last_became_peered":"2024-04-25 02:05:47.380213","last_unstale":"2024-04-25 02:05:47.387497","last_undegraded":"2024-04-25 02:05:47.387497","last_fullsized":"2024-04-25 02:05:47.387497","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353098","last_change":"2024-04-25 02:05:47.002799","last_active":"2024-04-25 02:05:47.353098","last_peered":"2024-04-25 02:05:47.353098","last_clean":"2024-04-25 02:05:47.353098","last_became_active":"2024-04-25 02:05:47.002131","last_became_peered":"2024-04-25 02:05:47.002131","last_unstale":"2024-04-25 02:05:47.353098","last_undegraded":"2024-04-25 02:05:47.353098","last_fullsized":"2024-04-25 02:05:47.353098","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386374","last_change":"2024-04-25 02:05:47.372655","last_active":"2024-04-25 02:05:47.386374","last_peered":"2024-04-25 02:05:47.386374","last_clean":"2024-04-25 02:05:47.386374","last_became_active":"2024-04-25 02:05:47.372344","last_became_peered":"2024-04-25 02:05:47.372344","last_unstale":"2024-04-25 02:05:47.386374","last_undegraded":"2024-04-25 02:05:47.386374","last_fullsized":"2024-04-25 02:05:47.386374","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352064","last_change":"2024-04-25 02:05:46.999849","last_active":"2024-04-25 02:05:47.352064","last_peered":"2024-04-25 02:05:47.352064","last_clean":"2024-04-25 02:05:47.352064","last_became_active":"2024-04-25 02:05:46.999494","last_became_peered":"2024-04-25 02:05:46.999494","last_unstale":"2024-04-25 02:05:47.352064","last_undegraded":"2024-04-25 02:05:47.352064","last_fullsized":"2024-04-25 02:05:47.352064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388549","last_change":"2024-04-25 02:05:47.377522","last_active":"2024-04-25 02:05:47.388549","last_peered":"2024-04-25 02:05:47.388549","last_clean":"2024-04-25 02:05:47.388549","last_became_active":"2024-04-25 02:05:47.374641","last_became_peered":"2024-04-25 02:05:47.374641","last_unstale":"2024-04-25 02:05:47.388549","last_undegraded":"2024-04-25 02:05:47.388549","last_fullsized":"2024-04-25 02:05:47.388549","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389608","last_change":"2024-04-25 02:05:47.017557","last_active":"2024-04-25 02:05:47.389608","last_peered":"2024-04-25 02:05:47.389608","last_clean":"2024-04-25 02:05:47.389608","last_became_active":"2024-04-25 02:05:47.017189","last_became_peered":"2024-04-25 02:05:47.017189","last_unstale":"2024-04-25 02:05:47.389608","last_undegraded":"2024-04-25 02:05:47.389608","last_fullsized":"2024-04-25 02:05:47.389608","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389984","last_change":"2024-04-25 02:05:47.386122","last_active":"2024-04-25 02:05:47.389984","last_peered":"2024-04-25 02:05:47.389984","last_clean":"2024-04-25 02:05:47.389984","last_became_active":"2024-04-25 02:05:47.385756","last_became_peered":"2024-04-25 02:05:47.385756","last_unstale":"2024-04-25 02:05:47.389984","last_undegraded":"2024-04-25 02:05:47.389984","last_fullsized":"2024-04-25 02:05:47.389984","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352989","last_change":"2024-04-25 02:05:47.019790","last_active":"2024-04-25 02:05:47.352989","last_peered":"2024-04-25 02:05:47.352989","last_clean":"2024-04-25 02:05:47.352989","last_became_active":"2024-04-25 02:05:47.019471","last_became_peered":"2024-04-25 02:05:47.019471","last_unstale":"2024-04-25 02:05:47.352989","last_undegraded":"2024-04-25 02:05:47.352989","last_fullsized":"2024-04-25 02:05:47.352989","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389192","last_change":"2024-04-25 02:05:47.380774","last_active":"2024-04-25 02:05:47.389192","last_peered":"2024-04-25 02:05:47.389192","last_clean":"2024-04-25 02:05:47.389192","last_became_active":"2024-04-25 02:05:47.380517","last_became_peered":"2024-04-25 02:05:47.380517","last_unstale":"2024-04-25 02:05:47.389192","last_undegraded":"2024-04-25 02:05:47.389192","last_fullsized":"2024-04-25 02:05:47.389192","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352014","last_change":"2024-04-25 02:05:47.005189","last_active":"2024-04-25 02:05:47.352014","last_peered":"2024-04-25 02:05:47.352014","last_clean":"2024-04-25 02:05:47.352014","last_became_active":"2024-04-25 02:05:47.004657","last_became_peered":"2024-04-25 02:05:47.004657","last_unstale":"2024-04-25 02:05:47.352014","last_undegraded":"2024-04-25 02:05:47.352014","last_fullsized":"2024-04-25 02:05:47.352014","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388617","last_change":"2024-04-25 02:05:47.377256","last_active":"2024-04-25 02:05:47.388617","last_peered":"2024-04-25 02:05:47.388617","last_clean":"2024-04-25 02:05:47.388617","last_became_active":"2024-04-25 02:05:47.376589","last_became_peered":"2024-04-25 02:05:47.376589","last_unstale":"2024-04-25 02:05:47.388617","last_undegraded":"2024-04-25 02:05:47.388617","last_fullsized":"2024-04-25 02:05:47.388617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359016","last_change":"2024-04-25 02:05:46.994018","last_active":"2024-04-25 02:05:47.359016","last_peered":"2024-04-25 02:05:47.359016","last_clean":"2024-04-25 02:05:47.359016","last_became_active":"2024-04-25 02:05:46.993698","last_became_peered":"2024-04-25 02:05:46.993698","last_unstale":"2024-04-25 02:05:47.359016","last_undegraded":"2024-04-25 02:05:47.359016","last_fullsized":"2024-04-25 02:05:47.359016","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389233","last_change":"2024-04-25 02:05:47.382653","last_active":"2024-04-25 02:05:47.389233","last_peered":"2024-04-25 02:05:47.389233","last_clean":"2024-04-25 02:05:47.389233","last_became_active":"2024-04-25 02:05:47.382376","last_became_peered":"2024-04-25 02:05:47.382376","last_unstale":"2024-04-25 02:05:47.389233","last_undegraded":"2024-04-25 02:05:47.389233","last_fullsized":"2024-04-25 02:05:47.389233","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352520","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:05:47.352520","last_peered":"2024-04-25 02:05:47.352520","last_clean":"2024-04-25 02:05:47.352520","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:05:47.352520","last_undegraded":"2024-04-25 02:05:47.352520","last_fullsized":"2024-04-25 02:05:47.352520","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353532","last_change":"2024-04-25 02:05:47.001851","last_active":"2024-04-25 02:05:47.353532","last_peered":"2024-04-25 02:05:47.353532","last_clean":"2024-04-25 02:05:47.353532","last_became_active":"2024-04-25 02:05:47.001503","last_became_peered":"2024-04-25 02:05:47.001503","last_unstale":"2024-04-25 02:05:47.353532","last_undegraded":"2024-04-25 02:05:47.353532","last_fullsized":"2024-04-25 02:05:47.353532","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384277","last_change":"2024-04-25 02:05:47.378248","last_active":"2024-04-25 02:05:47.384277","last_peered":"2024-04-25 02:05:47.384277","last_clean":"2024-04-25 02:05:47.384277","last_became_active":"2024-04-25 02:05:47.377943","last_became_peered":"2024-04-25 02:05:47.377943","last_unstale":"2024-04-25 02:05:47.384277","last_undegraded":"2024-04-25 02:05:47.384277","last_fullsized":"2024-04-25 02:05:47.384277","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360052","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:05:47.360052","last_peered":"2024-04-25 02:05:47.360052","last_clean":"2024-04-25 02:05:47.360052","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:05:47.360052","last_undegraded":"2024-04-25 02:05:47.360052","last_fullsized":"2024-04-25 02:05:47.360052","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388406","last_change":"2024-04-25 02:05:47.021725","last_active":"2024-04-25 02:05:47.388406","last_peered":"2024-04-25 02:05:47.388406","last_clean":"2024-04-25 02:05:47.388406","last_became_active":"2024-04-25 02:05:47.021378","last_became_peered":"2024-04-25 02:05:47.021378","last_unstale":"2024-04-25 02:05:47.388406","last_undegraded":"2024-04-25 02:05:47.388406","last_fullsized":"2024-04-25 02:05:47.388406","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352584","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:05:47.352584","last_peered":"2024-04-25 02:05:47.352584","last_clean":"2024-04-25 02:05:47.352584","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:05:47.352584","last_undegraded":"2024-04-25 02:05:47.352584","last_fullsized":"2024-04-25 02:05:47.352584","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356151","last_change":"2024-04-25 02:05:47.028109","last_active":"2024-04-25 02:05:47.356151","last_peered":"2024-04-25 02:05:47.356151","last_clean":"2024-04-25 02:05:47.356151","last_became_active":"2024-04-25 02:05:47.026998","last_became_peered":"2024-04-25 02:05:47.026998","last_unstale":"2024-04-25 02:05:47.356151","last_undegraded":"2024-04-25 02:05:47.356151","last_fullsized":"2024-04-25 02:05:47.356151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388917","last_change":"2024-04-25 02:05:47.384104","last_active":"2024-04-25 02:05:47.388917","last_peered":"2024-04-25 02:05:47.388917","last_clean":"2024-04-25 02:05:47.388917","last_became_active":"2024-04-25 02:05:47.383783","last_became_peered":"2024-04-25 02:05:47.383783","last_unstale":"2024-04-25 02:05:47.388917","last_undegraded":"2024-04-25 02:05:47.388917","last_fullsized":"2024-04-25 02:05:47.388917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360990","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:05:47.360990","last_peered":"2024-04-25 02:05:47.360990","last_clean":"2024-04-25 02:05:47.360990","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:05:47.360990","last_undegraded":"2024-04-25 02:05:47.360990","last_fullsized":"2024-04-25 02:05:47.360990","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351208","last_change":"2024-04-25 02:05:47.013050","last_active":"2024-04-25 02:05:47.351208","last_peered":"2024-04-25 02:05:47.351208","last_clean":"2024-04-25 02:05:47.351208","last_became_active":"2024-04-25 02:05:47.012558","last_became_peered":"2024-04-25 02:05:47.012558","last_unstale":"2024-04-25 02:05:47.351208","last_undegraded":"2024-04-25 02:05:47.351208","last_fullsized":"2024-04-25 02:05:47.351208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373782","last_change":"2024-04-25 02:05:47.363093","last_active":"2024-04-25 02:05:47.373782","last_peered":"2024-04-25 02:05:47.373782","last_clean":"2024-04-25 02:05:47.373782","last_became_active":"2024-04-25 02:05:47.362753","last_became_peered":"2024-04-25 02:05:47.362753","last_unstale":"2024-04-25 02:05:47.373782","last_undegraded":"2024-04-25 02:05:47.373782","last_fullsized":"2024-04-25 02:05:47.373782","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352385","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:05:47.352385","last_peered":"2024-04-25 02:05:47.352385","last_clean":"2024-04-25 02:05:47.352385","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:05:47.352385","last_undegraded":"2024-04-25 02:05:47.352385","last_fullsized":"2024-04-25 02:05:47.352385","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356625","last_change":"2024-04-25 02:05:47.018087","last_active":"2024-04-25 02:05:47.356625","last_peered":"2024-04-25 02:05:47.356625","last_clean":"2024-04-25 02:05:47.356625","last_became_active":"2024-04-25 02:05:47.017799","last_became_peered":"2024-04-25 02:05:47.017799","last_unstale":"2024-04-25 02:05:47.356625","last_undegraded":"2024-04-25 02:05:47.356625","last_fullsized":"2024-04-25 02:05:47.356625","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387244","last_change":"2024-04-25 02:05:47.375657","last_active":"2024-04-25 02:05:47.387244","last_peered":"2024-04-25 02:05:47.387244","last_clean":"2024-04-25 02:05:47.387244","last_became_active":"2024-04-25 02:05:47.375334","last_became_peered":"2024-04-25 02:05:47.375334","last_unstale":"2024-04-25 02:05:47.387244","last_undegraded":"2024-04-25 02:05:47.387244","last_fullsized":"2024-04-25 02:05:47.387244","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357499","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:05:47.357499","last_peered":"2024-04-25 02:05:47.357499","last_clean":"2024-04-25 02:05:47.357499","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:05:47.357499","last_undegraded":"2024-04-25 02:05:47.357499","last_fullsized":"2024-04-25 02:05:47.357499","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358000","last_change":"2024-04-25 02:05:47.029097","last_active":"2024-04-25 02:05:47.358000","last_peered":"2024-04-25 02:05:47.358000","last_clean":"2024-04-25 02:05:47.358000","last_became_active":"2024-04-25 02:05:47.025880","last_became_peered":"2024-04-25 02:05:47.025880","last_unstale":"2024-04-25 02:05:47.358000","last_undegraded":"2024-04-25 02:05:47.358000","last_fullsized":"2024-04-25 02:05:47.358000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390611","last_change":"2024-04-25 02:05:47.384976","last_active":"2024-04-25 02:05:47.390611","last_peered":"2024-04-25 02:05:47.390611","last_clean":"2024-04-25 02:05:47.390611","last_became_active":"2024-04-25 02:05:47.384672","last_became_peered":"2024-04-25 02:05:47.384672","last_unstale":"2024-04-25 02:05:47.390611","last_undegraded":"2024-04-25 02:05:47.390611","last_fullsized":"2024-04-25 02:05:47.390611","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360865","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:05:47.360865","last_peered":"2024-04-25 02:05:47.360865","last_clean":"2024-04-25 02:05:47.360865","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:05:47.360865","last_undegraded":"2024-04-25 02:05:47.360865","last_fullsized":"2024-04-25 02:05:47.360865","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359901","last_change":"2024-04-25 02:05:47.026109","last_active":"2024-04-25 02:05:47.359901","last_peered":"2024-04-25 02:05:47.359901","last_clean":"2024-04-25 02:05:47.359901","last_became_active":"2024-04-25 02:05:47.025764","last_became_peered":"2024-04-25 02:05:47.025764","last_unstale":"2024-04-25 02:05:47.359901","last_undegraded":"2024-04-25 02:05:47.359901","last_fullsized":"2024-04-25 02:05:47.359901","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382178","last_change":"2024-04-25 02:05:47.377843","last_active":"2024-04-25 02:05:47.382178","last_peered":"2024-04-25 02:05:47.382178","last_clean":"2024-04-25 02:05:47.382178","last_became_active":"2024-04-25 02:05:47.377538","last_became_peered":"2024-04-25 02:05:47.377538","last_unstale":"2024-04-25 02:05:47.382178","last_undegraded":"2024-04-25 02:05:47.382178","last_fullsized":"2024-04-25 02:05:47.382178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352612","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:05:47.352612","last_peered":"2024-04-25 02:05:47.352612","last_clean":"2024-04-25 02:05:47.352612","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:05:47.352612","last_undegraded":"2024-04-25 02:05:47.352612","last_fullsized":"2024-04-25 02:05:47.352612","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354313","last_change":"2024-04-25 02:05:47.004781","last_active":"2024-04-25 02:05:47.354313","last_peered":"2024-04-25 02:05:47.354313","last_clean":"2024-04-25 02:05:47.354313","last_became_active":"2024-04-25 02:05:47.004453","last_became_peered":"2024-04-25 02:05:47.004453","last_unstale":"2024-04-25 02:05:47.354313","last_undegraded":"2024-04-25 02:05:47.354313","last_fullsized":"2024-04-25 02:05:47.354313","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380248","last_change":"2024-04-25 02:05:47.376611","last_active":"2024-04-25 02:05:47.380248","last_peered":"2024-04-25 02:05:47.380248","last_clean":"2024-04-25 02:05:47.380248","last_became_active":"2024-04-25 02:05:47.376284","last_became_peered":"2024-04-25 02:05:47.376284","last_unstale":"2024-04-25 02:05:47.380248","last_undegraded":"2024-04-25 02:05:47.380248","last_fullsized":"2024-04-25 02:05:47.380248","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389945","last_change":"2024-04-25 02:05:47.387545","last_active":"2024-04-25 02:05:47.389945","last_peered":"2024-04-25 02:05:47.389945","last_clean":"2024-04-25 02:05:47.389945","last_became_active":"2024-04-25 02:05:47.387246","last_became_peered":"2024-04-25 02:05:47.387246","last_unstale":"2024-04-25 02:05:47.389945","last_undegraded":"2024-04-25 02:05:47.389945","last_fullsized":"2024-04-25 02:05:47.389945","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361706","last_change":"2024-04-25 02:05:47.006606","last_active":"2024-04-25 02:05:47.361706","last_peered":"2024-04-25 02:05:47.361706","last_clean":"2024-04-25 02:05:47.361706","last_became_active":"2024-04-25 02:05:47.006296","last_became_peered":"2024-04-25 02:05:47.006296","last_unstale":"2024-04-25 02:05:47.361706","last_undegraded":"2024-04-25 02:05:47.361706","last_fullsized":"2024-04-25 02:05:47.361706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387972","last_change":"2024-04-25 02:05:47.381933","last_active":"2024-04-25 02:05:47.387972","last_peered":"2024-04-25 02:05:47.387972","last_clean":"2024-04-25 02:05:47.387972","last_became_active":"2024-04-25 02:05:47.379588","last_became_peered":"2024-04-25 02:05:47.379588","last_unstale":"2024-04-25 02:05:47.387972","last_undegraded":"2024-04-25 02:05:47.387972","last_fullsized":"2024-04-25 02:05:47.387972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378078","last_change":"2024-04-25 02:05:47.008840","last_active":"2024-04-25 02:05:47.378078","last_peered":"2024-04-25 02:05:47.378078","last_clean":"2024-04-25 02:05:47.378078","last_became_active":"2024-04-25 02:05:47.008521","last_became_peered":"2024-04-25 02:05:47.008521","last_unstale":"2024-04-25 02:05:47.378078","last_undegraded":"2024-04-25 02:05:47.378078","last_fullsized":"2024-04-25 02:05:47.378078","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385090","last_change":"2024-04-25 02:05:47.378449","last_active":"2024-04-25 02:05:47.385090","last_peered":"2024-04-25 02:05:47.385090","last_clean":"2024-04-25 02:05:47.385090","last_became_active":"2024-04-25 02:05:47.371394","last_became_peered":"2024-04-25 02:05:47.371394","last_unstale":"2024-04-25 02:05:47.385090","last_undegraded":"2024-04-25 02:05:47.385090","last_fullsized":"2024-04-25 02:05:47.385090","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389698","last_change":"2024-04-25 02:05:47.021735","last_active":"2024-04-25 02:05:47.389698","last_peered":"2024-04-25 02:05:47.389698","last_clean":"2024-04-25 02:05:47.389698","last_became_active":"2024-04-25 02:05:47.021400","last_became_peered":"2024-04-25 02:05:47.021400","last_unstale":"2024-04-25 02:05:47.389698","last_undegraded":"2024-04-25 02:05:47.389698","last_fullsized":"2024-04-25 02:05:47.389698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389987","last_change":"2024-04-25 02:05:47.383033","last_active":"2024-04-25 02:05:47.389987","last_peered":"2024-04-25 02:05:47.389987","last_clean":"2024-04-25 02:05:47.389987","last_became_active":"2024-04-25 02:05:47.382717","last_became_peered":"2024-04-25 02:05:47.382717","last_unstale":"2024-04-25 02:05:47.389987","last_undegraded":"2024-04-25 02:05:47.389987","last_fullsized":"2024-04-25 02:05:47.389987","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389376","last_change":"2024-04-25 02:05:47.014112","last_active":"2024-04-25 02:05:47.389376","last_peered":"2024-04-25 02:05:47.389376","last_clean":"2024-04-25 02:05:47.389376","last_became_active":"2024-04-25 02:05:47.013624","last_became_peered":"2024-04-25 02:05:47.013624","last_unstale":"2024-04-25 02:05:47.389376","last_undegraded":"2024-04-25 02:05:47.389376","last_fullsized":"2024-04-25 02:05:47.389376","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380606","last_change":"2024-04-25 02:05:47.373843","last_active":"2024-04-25 02:05:47.380606","last_peered":"2024-04-25 02:05:47.380606","last_clean":"2024-04-25 02:05:47.380606","last_became_active":"2024-04-25 02:05:47.369284","last_became_peered":"2024-04-25 02:05:47.369284","last_unstale":"2024-04-25 02:05:47.380606","last_undegraded":"2024-04-25 02:05:47.380606","last_fullsized":"2024-04-25 02:05:47.380606","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356604","last_change":"2024-04-25 02:05:47.028330","last_active":"2024-04-25 02:05:47.356604","last_peered":"2024-04-25 02:05:47.356604","last_clean":"2024-04-25 02:05:47.356604","last_became_active":"2024-04-25 02:05:47.027257","last_became_peered":"2024-04-25 02:05:47.027257","last_unstale":"2024-04-25 02:05:47.356604","last_undegraded":"2024-04-25 02:05:47.356604","last_fullsized":"2024-04-25 02:05:47.356604","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.375879","last_change":"2024-04-25 02:05:47.366400","last_active":"2024-04-25 02:05:47.375879","last_peered":"2024-04-25 02:05:47.375879","last_clean":"2024-04-25 02:05:47.375879","last_became_active":"2024-04-25 02:05:47.366000","last_became_peered":"2024-04-25 02:05:47.366000","last_unstale":"2024-04-25 02:05:47.375879","last_undegraded":"2024-04-25 02:05:47.375879","last_fullsized":"2024-04-25 02:05:47.375879","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351200","last_change":"2024-04-25 02:05:46.999953","last_active":"2024-04-25 02:05:47.351200","last_peered":"2024-04-25 02:05:47.351200","last_clean":"2024-04-25 02:05:47.351200","last_became_active":"2024-04-25 02:05:46.999606","last_became_peered":"2024-04-25 02:05:46.999606","last_unstale":"2024-04-25 02:05:47.351200","last_undegraded":"2024-04-25 02:05:47.351200","last_fullsized":"2024-04-25 02:05:47.351200","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387617","last_change":"2024-04-25 02:05:47.381525","last_active":"2024-04-25 02:05:47.387617","last_peered":"2024-04-25 02:05:47.387617","last_clean":"2024-04-25 02:05:47.387617","last_became_active":"2024-04-25 02:05:47.378390","last_became_peered":"2024-04-25 02:05:47.378390","last_unstale":"2024-04-25 02:05:47.387617","last_undegraded":"2024-04-25 02:05:47.387617","last_fullsized":"2024-04-25 02:05:47.387617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363760","last_change":"2024-04-25 02:05:47.026754","last_active":"2024-04-25 02:05:47.363760","last_peered":"2024-04-25 02:05:47.363760","last_clean":"2024-04-25 02:05:47.363760","last_became_active":"2024-04-25 02:05:47.026391","last_became_peered":"2024-04-25 02:05:47.026391","last_unstale":"2024-04-25 02:05:47.363760","last_undegraded":"2024-04-25 02:05:47.363760","last_fullsized":"2024-04-25 02:05:47.363760","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388695","last_change":"2024-04-25 02:05:47.379347","last_active":"2024-04-25 02:05:47.388695","last_peered":"2024-04-25 02:05:47.388695","last_clean":"2024-04-25 02:05:47.388695","last_became_active":"2024-04-25 02:05:47.379040","last_became_peered":"2024-04-25 02:05:47.379040","last_unstale":"2024-04-25 02:05:47.388695","last_undegraded":"2024-04-25 02:05:47.388695","last_fullsized":"2024-04-25 02:05:47.388695","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358961","last_change":"2024-04-25 02:05:47.027710","last_active":"2024-04-25 02:05:47.358961","last_peered":"2024-04-25 02:05:47.358961","last_clean":"2024-04-25 02:05:47.358961","last_became_active":"2024-04-25 02:05:47.027316","last_became_peered":"2024-04-25 02:05:47.027316","last_unstale":"2024-04-25 02:05:47.358961","last_undegraded":"2024-04-25 02:05:47.358961","last_fullsized":"2024-04-25 02:05:47.358961","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374780","last_change":"2024-04-25 02:05:47.372923","last_active":"2024-04-25 02:05:47.374780","last_peered":"2024-04-25 02:05:47.374780","last_clean":"2024-04-25 02:05:47.374780","last_became_active":"2024-04-25 02:05:47.372581","last_became_peered":"2024-04-25 02:05:47.372581","last_unstale":"2024-04-25 02:05:47.374780","last_undegraded":"2024-04-25 02:05:47.374780","last_fullsized":"2024-04-25 02:05:47.374780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354411","last_change":"2024-04-25 02:05:47.004609","last_active":"2024-04-25 02:05:47.354411","last_peered":"2024-04-25 02:05:47.354411","last_clean":"2024-04-25 02:05:47.354411","last_became_active":"2024-04-25 02:05:47.001832","last_became_peered":"2024-04-25 02:05:47.001832","last_unstale":"2024-04-25 02:05:47.354411","last_undegraded":"2024-04-25 02:05:47.354411","last_fullsized":"2024-04-25 02:05:47.354411","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390986","last_change":"2024-04-25 02:05:47.380256","last_active":"2024-04-25 02:05:47.390986","last_peered":"2024-04-25 02:05:47.390986","last_clean":"2024-04-25 02:05:47.390986","last_became_active":"2024-04-25 02:05:47.379963","last_became_peered":"2024-04-25 02:05:47.379963","last_unstale":"2024-04-25 02:05:47.390986","last_undegraded":"2024-04-25 02:05:47.390986","last_fullsized":"2024-04-25 02:05:47.390986","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352630","last_change":"2024-04-25 02:05:46.996348","last_active":"2024-04-25 02:05:47.352630","last_peered":"2024-04-25 02:05:47.352630","last_clean":"2024-04-25 02:05:47.352630","last_became_active":"2024-04-25 02:05:46.996069","last_became_peered":"2024-04-25 02:05:46.996069","last_unstale":"2024-04-25 02:05:47.352630","last_undegraded":"2024-04-25 02:05:47.352630","last_fullsized":"2024-04-25 02:05:47.352630","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389206","last_change":"2024-04-25 02:05:47.382589","last_active":"2024-04-25 02:05:47.389206","last_peered":"2024-04-25 02:05:47.389206","last_clean":"2024-04-25 02:05:47.389206","last_became_active":"2024-04-25 02:05:47.382307","last_became_peered":"2024-04-25 02:05:47.382307","last_unstale":"2024-04-25 02:05:47.389206","last_undegraded":"2024-04-25 02:05:47.389206","last_fullsized":"2024-04-25 02:05:47.389206","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-04-25 02:05:48.371682","last_change":"2024-04-25 02:05:46.999274","last_active":"2024-04-25 02:05:48.371682","last_peered":"2024-04-25 02:05:48.371682","last_clean":"2024-04-25 02:05:48.371682","last_became_active":"2024-04-25 02:05:46.998876","last_became_peered":"2024-04-25 02:05:46.998876","last_unstale":"2024-04-25 02:05:48.371682","last_undegraded":"2024-04-25 02:05:48.371682","last_fullsized":"2024-04-25 02:05:48.371682","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382025","last_change":"2024-04-25 02:05:47.377487","last_active":"2024-04-25 02:05:47.382025","last_peered":"2024-04-25 02:05:47.382025","last_clean":"2024-04-25 02:05:47.382025","last_became_active":"2024-04-25 02:05:47.376770","last_became_peered":"2024-04-25 02:05:47.376770","last_unstale":"2024-04-25 02:05:47.382025","last_undegraded":"2024-04-25 02:05:47.382025","last_fullsized":"2024-04-25 02:05:47.382025","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361361","last_change":"2024-04-25 02:05:47.026964","last_active":"2024-04-25 02:05:47.361361","last_peered":"2024-04-25 02:05:47.361361","last_clean":"2024-04-25 02:05:47.361361","last_became_active":"2024-04-25 02:05:47.026604","last_became_peered":"2024-04-25 02:05:47.026604","last_unstale":"2024-04-25 02:05:47.361361","last_undegraded":"2024-04-25 02:05:47.361361","last_fullsized":"2024-04-25 02:05:47.361361","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386703","last_change":"2024-04-25 02:05:47.375591","last_active":"2024-04-25 02:05:47.386703","last_peered":"2024-04-25 02:05:47.386703","last_clean":"2024-04-25 02:05:47.386703","last_became_active":"2024-04-25 02:05:47.375271","last_became_peered":"2024-04-25 02:05:47.375271","last_unstale":"2024-04-25 02:05:47.386703","last_undegraded":"2024-04-25 02:05:47.386703","last_fullsized":"2024-04-25 02:05:47.386703","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362340","last_change":"2024-04-25 02:05:47.028567","last_active":"2024-04-25 02:05:47.362340","last_peered":"2024-04-25 02:05:47.362340","last_clean":"2024-04-25 02:05:47.362340","last_became_active":"2024-04-25 02:05:47.027520","last_became_peered":"2024-04-25 02:05:47.027520","last_unstale":"2024-04-25 02:05:47.362340","last_undegraded":"2024-04-25 02:05:47.362340","last_fullsized":"2024-04-25 02:05:47.362340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387289","last_change":"2024-04-25 02:05:47.376362","last_active":"2024-04-25 02:05:47.387289","last_peered":"2024-04-25 02:05:47.387289","last_clean":"2024-04-25 02:05:47.387289","last_became_active":"2024-04-25 02:05:47.376045","last_became_peered":"2024-04-25 02:05:47.376045","last_unstale":"2024-04-25 02:05:47.387289","last_undegraded":"2024-04-25 02:05:47.387289","last_fullsized":"2024-04-25 02:05:47.387289","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351558","last_change":"2024-04-25 02:05:47.018376","last_active":"2024-04-25 02:05:47.351558","last_peered":"2024-04-25 02:05:47.351558","last_clean":"2024-04-25 02:05:47.351558","last_became_active":"2024-04-25 02:05:47.018044","last_became_peered":"2024-04-25 02:05:47.018044","last_unstale":"2024-04-25 02:05:47.351558","last_undegraded":"2024-04-25 02:05:47.351558","last_fullsized":"2024-04-25 02:05:47.351558","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389103","last_change":"2024-04-25 02:05:47.384783","last_active":"2024-04-25 02:05:47.389103","last_peered":"2024-04-25 02:05:47.389103","last_clean":"2024-04-25 02:05:47.389103","last_became_active":"2024-04-25 02:05:47.384440","last_became_peered":"2024-04-25 02:05:47.384440","last_unstale":"2024-04-25 02:05:47.389103","last_undegraded":"2024-04-25 02:05:47.389103","last_fullsized":"2024-04-25 02:05:47.389103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352883","last_change":"2024-04-25 02:05:47.000733","last_active":"2024-04-25 02:05:47.352883","last_peered":"2024-04-25 02:05:47.352883","last_clean":"2024-04-25 02:05:47.352883","last_became_active":"2024-04-25 02:05:47.000381","last_became_peered":"2024-04-25 02:05:47.000381","last_unstale":"2024-04-25 02:05:47.352883","last_undegraded":"2024-04-25 02:05:47.352883","last_fullsized":"2024-04-25 02:05:47.352883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372954","last_change":"2024-04-25 02:05:47.363717","last_active":"2024-04-25 02:05:47.372954","last_peered":"2024-04-25 02:05:47.372954","last_clean":"2024-04-25 02:05:47.372954","last_became_active":"2024-04-25 02:05:47.363378","last_became_peered":"2024-04-25 02:05:47.363378","last_unstale":"2024-04-25 02:05:47.372954","last_undegraded":"2024-04-25 02:05:47.372954","last_fullsized":"2024-04-25 02:05:47.372954","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377804","last_change":"2024-04-25 02:05:46.996992","last_active":"2024-04-25 02:05:47.377804","last_peered":"2024-04-25 02:05:47.377804","last_clean":"2024-04-25 02:05:47.377804","last_became_active":"2024-04-25 02:05:46.996648","last_became_peered":"2024-04-25 02:05:46.996648","last_unstale":"2024-04-25 02:05:47.377804","last_undegraded":"2024-04-25 02:05:47.377804","last_fullsized":"2024-04-25 02:05:47.377804","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389212","last_change":"2024-04-25 02:05:47.380340","last_active":"2024-04-25 02:05:47.389212","last_peered":"2024-04-25 02:05:47.389212","last_clean":"2024-04-25 02:05:47.389212","last_became_active":"2024-04-25 02:05:47.380051","last_became_peered":"2024-04-25 02:05:47.380051","last_unstale":"2024-04-25 02:05:47.389212","last_undegraded":"2024-04-25 02:05:47.389212","last_fullsized":"2024-04-25 02:05:47.389212","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351619","last_change":"2024-04-25 02:05:46.999913","last_active":"2024-04-25 02:05:47.351619","last_peered":"2024-04-25 02:05:47.351619","last_clean":"2024-04-25 02:05:47.351619","last_became_active":"2024-04-25 02:05:46.999553","last_became_peered":"2024-04-25 02:05:46.999553","last_unstale":"2024-04-25 02:05:47.351619","last_undegraded":"2024-04-25 02:05:47.351619","last_fullsized":"2024-04-25 02:05:47.351619","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384258","last_change":"2024-04-25 02:05:47.377775","last_active":"2024-04-25 02:05:47.384258","last_peered":"2024-04-25 02:05:47.384258","last_clean":"2024-04-25 02:05:47.384258","last_became_active":"2024-04-25 02:05:47.377456","last_became_peered":"2024-04-25 02:05:47.377456","last_unstale":"2024-04-25 02:05:47.384258","last_undegraded":"2024-04-25 02:05:47.384258","last_fullsized":"2024-04-25 02:05:47.384258","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389886","last_change":"2024-04-25 02:05:47.022408","last_active":"2024-04-25 02:05:47.389886","last_peered":"2024-04-25 02:05:47.389886","last_clean":"2024-04-25 02:05:47.389886","last_became_active":"2024-04-25 02:05:47.022145","last_became_peered":"2024-04-25 02:05:47.022145","last_unstale":"2024-04-25 02:05:47.389886","last_undegraded":"2024-04-25 02:05:47.389886","last_fullsized":"2024-04-25 02:05:47.389886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389273","last_change":"2024-04-25 02:05:47.383157","last_active":"2024-04-25 02:05:47.389273","last_peered":"2024-04-25 02:05:47.389273","last_clean":"2024-04-25 02:05:47.389273","last_became_active":"2024-04-25 02:05:47.382824","last_became_peered":"2024-04-25 02:05:47.382824","last_unstale":"2024-04-25 02:05:47.389273","last_undegraded":"2024-04-25 02:05:47.389273","last_fullsized":"2024-04-25 02:05:47.389273","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353638","last_change":"2024-04-25 02:05:46.999652","last_active":"2024-04-25 02:05:47.353638","last_peered":"2024-04-25 02:05:47.353638","last_clean":"2024-04-25 02:05:47.353638","last_became_active":"2024-04-25 02:05:46.999330","last_became_peered":"2024-04-25 02:05:46.999330","last_unstale":"2024-04-25 02:05:47.353638","last_undegraded":"2024-04-25 02:05:47.353638","last_fullsized":"2024-04-25 02:05:47.353638","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382043","last_change":"2024-04-25 02:05:47.377666","last_active":"2024-04-25 02:05:47.382043","last_peered":"2024-04-25 02:05:47.382043","last_clean":"2024-04-25 02:05:47.382043","last_became_active":"2024-04-25 02:05:47.376996","last_became_peered":"2024-04-25 02:05:47.376996","last_unstale":"2024-04-25 02:05:47.382043","last_undegraded":"2024-04-25 02:05:47.382043","last_fullsized":"2024-04-25 02:05:47.382043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361467","last_change":"2024-04-25 02:05:47.026476","last_active":"2024-04-25 02:05:47.361467","last_peered":"2024-04-25 02:05:47.361467","last_clean":"2024-04-25 02:05:47.361467","last_became_active":"2024-04-25 02:05:47.025938","last_became_peered":"2024-04-25 02:05:47.025938","last_unstale":"2024-04-25 02:05:47.361467","last_undegraded":"2024-04-25 02:05:47.361467","last_fullsized":"2024-04-25 02:05:47.361467","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373149","last_change":"2024-04-25 02:05:47.368468","last_active":"2024-04-25 02:05:47.373149","last_peered":"2024-04-25 02:05:47.373149","last_clean":"2024-04-25 02:05:47.373149","last_became_active":"2024-04-25 02:05:47.368132","last_became_peered":"2024-04-25 02:05:47.368132","last_unstale":"2024-04-25 02:05:47.373149","last_undegraded":"2024-04-25 02:05:47.373149","last_fullsized":"2024-04-25 02:05:47.373149","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388094","last_change":"2024-04-25 02:05:47.009725","last_active":"2024-04-25 02:05:47.388094","last_peered":"2024-04-25 02:05:47.388094","last_clean":"2024-04-25 02:05:47.388094","last_became_active":"2024-04-25 02:05:47.007964","last_became_peered":"2024-04-25 02:05:47.007964","last_unstale":"2024-04-25 02:05:47.388094","last_undegraded":"2024-04-25 02:05:47.388094","last_fullsized":"2024-04-25 02:05:47.388094","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388711","last_change":"2024-04-25 02:05:47.379616","last_active":"2024-04-25 02:05:47.388711","last_peered":"2024-04-25 02:05:47.388711","last_clean":"2024-04-25 02:05:47.388711","last_became_active":"2024-04-25 02:05:47.379103","last_became_peered":"2024-04-25 02:05:47.379103","last_unstale":"2024-04-25 02:05:47.388711","last_undegraded":"2024-04-25 02:05:47.388711","last_fullsized":"2024-04-25 02:05:47.388711","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360333","last_change":"2024-04-25 02:05:47.009452","last_active":"2024-04-25 02:05:47.360333","last_peered":"2024-04-25 02:05:47.360333","last_clean":"2024-04-25 02:05:47.360333","last_became_active":"2024-04-25 02:05:47.009116","last_became_peered":"2024-04-25 02:05:47.009116","last_unstale":"2024-04-25 02:05:47.360333","last_undegraded":"2024-04-25 02:05:47.360333","last_fullsized":"2024-04-25 02:05:47.360333","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389963","last_change":"2024-04-25 02:05:47.386054","last_active":"2024-04-25 02:05:47.389963","last_peered":"2024-04-25 02:05:47.389963","last_clean":"2024-04-25 02:05:47.389963","last_became_active":"2024-04-25 02:05:47.383311","last_became_peered":"2024-04-25 02:05:47.383311","last_unstale":"2024-04-25 02:05:47.389963","last_undegraded":"2024-04-25 02:05:47.389963","last_fullsized":"2024-04-25 02:05:47.389963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351815","last_change":"2024-04-25 02:05:47.020004","last_active":"2024-04-25 02:05:47.351815","last_peered":"2024-04-25 02:05:47.351815","last_clean":"2024-04-25 02:05:47.351815","last_became_active":"2024-04-25 02:05:47.019687","last_became_peered":"2024-04-25 02:05:47.019687","last_unstale":"2024-04-25 02:05:47.351815","last_undegraded":"2024-04-25 02:05:47.351815","last_fullsized":"2024-04-25 02:05:47.351815","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377719","last_change":"2024-04-25 02:05:47.365437","last_active":"2024-04-25 02:05:47.377719","last_peered":"2024-04-25 02:05:47.377719","last_clean":"2024-04-25 02:05:47.377719","last_became_active":"2024-04-25 02:05:47.365101","last_became_peered":"2024-04-25 02:05:47.365101","last_unstale":"2024-04-25 02:05:47.377719","last_undegraded":"2024-04-25 02:05:47.377719","last_fullsized":"2024-04-25 02:05:47.377719","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374047","last_change":"2024-04-25 02:05:46.993531","last_active":"2024-04-25 02:05:47.374047","last_peered":"2024-04-25 02:05:47.374047","last_clean":"2024-04-25 02:05:47.374047","last_became_active":"2024-04-25 02:05:46.993117","last_became_peered":"2024-04-25 02:05:46.993117","last_unstale":"2024-04-25 02:05:47.374047","last_undegraded":"2024-04-25 02:05:47.374047","last_fullsized":"2024-04-25 02:05:47.374047","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390894","last_change":"2024-04-25 02:05:47.385729","last_active":"2024-04-25 02:05:47.390894","last_peered":"2024-04-25 02:05:47.390894","last_clean":"2024-04-25 02:05:47.390894","last_became_active":"2024-04-25 02:05:47.385421","last_became_peered":"2024-04-25 02:05:47.385421","last_unstale":"2024-04-25 02:05:47.390894","last_undegraded":"2024-04-25 02:05:47.390894","last_fullsized":"2024-04-25 02:05:47.390894","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391988","last_change":"2024-04-25 02:05:47.020323","last_active":"2024-04-25 02:05:47.391988","last_peered":"2024-04-25 02:05:47.391988","last_clean":"2024-04-25 02:05:47.391988","last_became_active":"2024-04-25 02:05:47.019973","last_became_peered":"2024-04-25 02:05:47.019973","last_unstale":"2024-04-25 02:05:47.391988","last_undegraded":"2024-04-25 02:05:47.391988","last_fullsized":"2024-04-25 02:05:47.391988","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384226","last_change":"2024-04-25 02:05:47.375256","last_active":"2024-04-25 02:05:47.384226","last_peered":"2024-04-25 02:05:47.384226","last_clean":"2024-04-25 02:05:47.384226","last_became_active":"2024-04-25 02:05:47.374920","last_became_peered":"2024-04-25 02:05:47.374920","last_unstale":"2024-04-25 02:05:47.384226","last_undegraded":"2024-04-25 02:05:47.384226","last_fullsized":"2024-04-25 02:05:47.384226","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353210","last_change":"2024-04-25 02:05:46.995620","last_active":"2024-04-25 02:05:47.353210","last_peered":"2024-04-25 02:05:47.353210","last_clean":"2024-04-25 02:05:47.353210","last_became_active":"2024-04-25 02:05:46.995117","last_became_peered":"2024-04-25 02:05:46.995117","last_unstale":"2024-04-25 02:05:47.353210","last_undegraded":"2024-04-25 02:05:47.353210","last_fullsized":"2024-04-25 02:05:47.353210","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374027","last_change":"2024-04-25 02:05:47.372331","last_active":"2024-04-25 02:05:47.374027","last_peered":"2024-04-25 02:05:47.374027","last_clean":"2024-04-25 02:05:47.374027","last_became_active":"2024-04-25 02:05:47.372004","last_became_peered":"2024-04-25 02:05:47.372004","last_unstale":"2024-04-25 02:05:47.374027","last_undegraded":"2024-04-25 02:05:47.374027","last_fullsized":"2024-04-25 02:05:47.374027","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353418","last_change":"2024-04-25 02:05:46.999650","last_active":"2024-04-25 02:05:47.353418","last_peered":"2024-04-25 02:05:47.353418","last_clean":"2024-04-25 02:05:47.353418","last_became_active":"2024-04-25 02:05:46.999284","last_became_peered":"2024-04-25 02:05:46.999284","last_unstale":"2024-04-25 02:05:47.353418","last_undegraded":"2024-04-25 02:05:47.353418","last_fullsized":"2024-04-25 02:05:47.353418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386278","last_change":"2024-04-25 02:05:47.380781","last_active":"2024-04-25 02:05:47.386278","last_peered":"2024-04-25 02:05:47.386278","last_clean":"2024-04-25 02:05:47.386278","last_became_active":"2024-04-25 02:05:47.380462","last_became_peered":"2024-04-25 02:05:47.380462","last_unstale":"2024-04-25 02:05:47.386278","last_undegraded":"2024-04-25 02:05:47.386278","last_fullsized":"2024-04-25 02:05:47.386278","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362868","last_change":"2024-04-25 02:05:47.001836","last_active":"2024-04-25 02:05:47.362868","last_peered":"2024-04-25 02:05:47.362868","last_clean":"2024-04-25 02:05:47.362868","last_became_active":"2024-04-25 02:05:47.001509","last_became_peered":"2024-04-25 02:05:47.001509","last_unstale":"2024-04-25 02:05:47.362868","last_undegraded":"2024-04-25 02:05:47.362868","last_fullsized":"2024-04-25 02:05:47.362868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383697","last_change":"2024-04-25 02:05:47.373785","last_active":"2024-04-25 02:05:47.383697","last_peered":"2024-04-25 02:05:47.383697","last_clean":"2024-04-25 02:05:47.383697","last_became_active":"2024-04-25 02:05:47.371646","last_became_peered":"2024-04-25 02:05:47.371646","last_unstale":"2024-04-25 02:05:47.383697","last_undegraded":"2024-04-25 02:05:47.383697","last_fullsized":"2024-04-25 02:05:47.383697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359221","last_change":"2024-04-25 02:05:47.009028","last_active":"2024-04-25 02:05:47.359221","last_peered":"2024-04-25 02:05:47.359221","last_clean":"2024-04-25 02:05:47.359221","last_became_active":"2024-04-25 02:05:47.007728","last_became_peered":"2024-04-25 02:05:47.007728","last_unstale":"2024-04-25 02:05:47.359221","last_undegraded":"2024-04-25 02:05:47.359221","last_fullsized":"2024-04-25 02:05:47.359221","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390062","last_change":"2024-04-25 02:05:47.386599","last_active":"2024-04-25 02:05:47.390062","last_peered":"2024-04-25 02:05:47.390062","last_clean":"2024-04-25 02:05:47.390062","last_became_active":"2024-04-25 02:05:47.383052","last_became_peered":"2024-04-25 02:05:47.383052","last_unstale":"2024-04-25 02:05:47.390062","last_undegraded":"2024-04-25 02:05:47.390062","last_fullsized":"2024-04-25 02:05:47.390062","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351457","last_change":"2024-04-25 02:05:46.992970","last_active":"2024-04-25 02:05:47.351457","last_peered":"2024-04-25 02:05:47.351457","last_clean":"2024-04-25 02:05:47.351457","last_became_active":"2024-04-25 02:05:46.992580","last_became_peered":"2024-04-25 02:05:46.992580","last_unstale":"2024-04-25 02:05:47.351457","last_undegraded":"2024-04-25 02:05:47.351457","last_fullsized":"2024-04-25 02:05:47.351457","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390594","last_change":"2024-04-25 02:05:47.384947","last_active":"2024-04-25 02:05:47.390594","last_peered":"2024-04-25 02:05:47.390594","last_clean":"2024-04-25 02:05:47.390594","last_became_active":"2024-04-25 02:05:47.384477","last_became_peered":"2024-04-25 02:05:47.384477","last_unstale":"2024-04-25 02:05:47.390594","last_undegraded":"2024-04-25 02:05:47.390594","last_fullsized":"2024-04-25 02:05:47.390594","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390564","last_change":"2024-04-25 02:05:47.016029","last_active":"2024-04-25 02:05:47.390564","last_peered":"2024-04-25 02:05:47.390564","last_clean":"2024-04-25 02:05:47.390564","last_became_active":"2024-04-25 02:05:47.015470","last_became_peered":"2024-04-25 02:05:47.015470","last_unstale":"2024-04-25 02:05:47.390564","last_undegraded":"2024-04-25 02:05:47.390564","last_fullsized":"2024-04-25 02:05:47.390564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377970","last_change":"2024-04-25 02:05:47.368583","last_active":"2024-04-25 02:05:47.377970","last_peered":"2024-04-25 02:05:47.377970","last_clean":"2024-04-25 02:05:47.377970","last_became_active":"2024-04-25 02:05:47.366798","last_became_peered":"2024-04-25 02:05:47.366798","last_unstale":"2024-04-25 02:05:47.377970","last_undegraded":"2024-04-25 02:05:47.377970","last_fullsized":"2024-04-25 02:05:47.377970","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388229","last_change":"2024-04-25 02:05:47.005838","last_active":"2024-04-25 02:05:47.388229","last_peered":"2024-04-25 02:05:47.388229","last_clean":"2024-04-25 02:05:47.388229","last_became_active":"2024-04-25 02:05:47.005500","last_became_peered":"2024-04-25 02:05:47.005500","last_unstale":"2024-04-25 02:05:47.388229","last_undegraded":"2024-04-25 02:05:47.388229","last_fullsized":"2024-04-25 02:05:47.388229","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386313","last_change":"2024-04-25 02:05:47.380789","last_active":"2024-04-25 02:05:47.386313","last_peered":"2024-04-25 02:05:47.386313","last_clean":"2024-04-25 02:05:47.386313","last_became_active":"2024-04-25 02:05:47.380537","last_became_peered":"2024-04-25 02:05:47.380537","last_unstale":"2024-04-25 02:05:47.386313","last_undegraded":"2024-04-25 02:05:47.386313","last_fullsized":"2024-04-25 02:05:47.386313","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388104","last_change":"2024-04-25 02:05:47.006598","last_active":"2024-04-25 02:05:47.388104","last_peered":"2024-04-25 02:05:47.388104","last_clean":"2024-04-25 02:05:47.388104","last_became_active":"2024-04-25 02:05:47.006139","last_became_peered":"2024-04-25 02:05:47.006139","last_unstale":"2024-04-25 02:05:47.388104","last_undegraded":"2024-04-25 02:05:47.388104","last_fullsized":"2024-04-25 02:05:47.388104","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378165","last_change":"2024-04-25 02:05:47.374238","last_active":"2024-04-25 02:05:47.378165","last_peered":"2024-04-25 02:05:47.378165","last_clean":"2024-04-25 02:05:47.378165","last_became_active":"2024-04-25 02:05:47.373927","last_became_peered":"2024-04-25 02:05:47.373927","last_unstale":"2024-04-25 02:05:47.378165","last_undegraded":"2024-04-25 02:05:47.378165","last_fullsized":"2024-04-25 02:05:47.378165","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353045","last_change":"2024-04-25 02:05:47.003496","last_active":"2024-04-25 02:05:47.353045","last_peered":"2024-04-25 02:05:47.353045","last_clean":"2024-04-25 02:05:47.353045","last_became_active":"2024-04-25 02:05:47.002906","last_became_peered":"2024-04-25 02:05:47.002906","last_unstale":"2024-04-25 02:05:47.353045","last_undegraded":"2024-04-25 02:05:47.353045","last_fullsized":"2024-04-25 02:05:47.353045","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390790","last_change":"2024-04-25 02:05:47.385923","last_active":"2024-04-25 02:05:47.390790","last_peered":"2024-04-25 02:05:47.390790","last_clean":"2024-04-25 02:05:47.390790","last_became_active":"2024-04-25 02:05:47.385607","last_became_peered":"2024-04-25 02:05:47.385607","last_unstale":"2024-04-25 02:05:47.390790","last_undegraded":"2024-04-25 02:05:47.390790","last_fullsized":"2024-04-25 02:05:47.390790","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362831","last_change":"2024-04-25 02:05:46.999151","last_active":"2024-04-25 02:05:47.362831","last_peered":"2024-04-25 02:05:47.362831","last_clean":"2024-04-25 02:05:47.362831","last_became_active":"2024-04-25 02:05:46.998843","last_became_peered":"2024-04-25 02:05:46.998843","last_unstale":"2024-04-25 02:05:47.362831","last_undegraded":"2024-04-25 02:05:47.362831","last_fullsized":"2024-04-25 02:05:47.362831","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387468","last_change":"2024-04-25 02:05:47.381229","last_active":"2024-04-25 02:05:47.387468","last_peered":"2024-04-25 02:05:47.387468","last_clean":"2024-04-25 02:05:47.387468","last_became_active":"2024-04-25 02:05:47.380920","last_became_peered":"2024-04-25 02:05:47.380920","last_unstale":"2024-04-25 02:05:47.387468","last_undegraded":"2024-04-25 02:05:47.387468","last_fullsized":"2024-04-25 02:05:47.387468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385052","last_change":"2024-04-25 02:05:47.002796","last_active":"2024-04-25 02:05:47.385052","last_peered":"2024-04-25 02:05:47.385052","last_clean":"2024-04-25 02:05:47.385052","last_became_active":"2024-04-25 02:05:47.002460","last_became_peered":"2024-04-25 02:05:47.002460","last_unstale":"2024-04-25 02:05:47.385052","last_undegraded":"2024-04-25 02:05:47.385052","last_fullsized":"2024-04-25 02:05:47.385052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]}]}]}} 2024-04-25T02:05:50.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:05:51.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.129 7f668811d700 1 Processor -- start 2024-04-25T02:05:51.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.129 7f668811d700 1 -- start start 2024-04-25T02:05:51.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f668811d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f668010cac0 0x7f66801a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f668811d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66801a6b60 0x7f66801a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f668811d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668010cf10 con 0x7f66800f58a0 2024-04-25T02:05:51.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f668811d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66800fa210 con 0x7f668010cac0 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f668811d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800f9540 con 0x7f66801a6b60 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f6685719700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66801a6b60 0x7f66801a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f6684f18700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f66800f58a0 0x7f668010c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57542/0 (socket says 172.21.15.57:57542) 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f668010cac0 0x7f66801a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f6684f18700 1 -- 172.21.15.57:0/3309501918 learned_addr learned my addr 172.21.15.57:0/3309501918 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667ffff700 1 -- 172.21.15.57:0/3309501918 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66801a6b60 msgr2=0x7f66801a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667ffff700 1 --2- 172.21.15.57:0/3309501918 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66801a6b60 0x7f66801a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667ffff700 1 -- 172.21.15.57:0/3309501918 >> v1:172.21.15.57:6789/0 conn(0x7f66800f58a0 legacy=0x7f668010c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667ffff700 1 -- 172.21.15.57:0/3309501918 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66801aa600 con 0x7f668010cac0 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667f7fe700 1 -- 172.21.15.57:0/3309501918 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255385728 0 0) 0x7f6670001110 con 0x7f66800f58a0 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667ffff700 1 --2- 172.21.15.57:0/3309501918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f668010cac0 0x7f66801a6530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6680113380 tx=0x7f666800ba20).ready entity=mon.0 client_cookie=569ef7ece2d350f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667f7fe700 1 -- 172.21.15.57:0/3309501918 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66801aa600 con 0x7f668010cac0 2024-04-25T02:05:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667f7fe700 1 -- 172.21.15.57:0/3309501918 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800d5c0 con 0x7f668010cac0 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f667f7fe700 1 -- 172.21.15.57:0/3309501918 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f666800d990 con 0x7f668010cac0 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f668811d700 1 -- 172.21.15.57:0/3309501918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f668010cac0 msgr2=0x7f66801a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.130 7f668811d700 1 --2- 172.21.15.57:0/3309501918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f668010cac0 0x7f66801a6530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6680113380 tx=0x7f666800ba20).stop 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.131 7f668811d700 1 -- 172.21.15.57:0/3309501918 shutdown_connections 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.131 7f668811d700 1 --2- 172.21.15.57:0/3309501918 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66801a6b60 0x7f66801a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.131 7f668811d700 1 --2- 172.21.15.57:0/3309501918 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f668010cac0 0x7f66801a6530 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.131 7f668811d700 1 -- 172.21.15.57:0/3309501918 >> 172.21.15.57:0/3309501918 conn(0x7f66801139f0 msgr2=0x7f66800f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.131 7f668811d700 1 -- 172.21.15.57:0/3309501918 shutdown_connections 2024-04-25T02:05:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.131 7f668811d700 1 -- 172.21.15.57:0/3309501918 wait complete. 2024-04-25T02:05:51.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.155 7f668811d700 1 Processor -- start 2024-04-25T02:05:51.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.155 7f668811d700 1 -- start start 2024-04-25T02:05:51.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f668811d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66800d53e0 0x7f66800d5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f668811d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f66800d5e60 0x7f66801b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f668811d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66801b2a60 0x7f66801b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f668811d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66801b34e0 con 0x7f66801b2a60 2024-04-25T02:05:51.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f668811d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800cea20 con 0x7f66800d53e0 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f668811d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66800cdc30 con 0x7f66800d5e60 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f6684f18700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66800d53e0 0x7f66800d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f6685719700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66801b2a60 0x7f66801b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f6684f18700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66800d53e0 0x7f66800d5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49510/0 (socket says 172.21.15.57:49510) 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f667ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f66800d5e60 0x7f66801b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f6685719700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66801b2a60 0x7f66801b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57244/0 (socket says 172.21.15.57:57244) 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f6684f18700 1 -- 172.21.15.57:0/1024340950 learned_addr learned my addr 172.21.15.57:0/1024340950 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f6684f18700 1 -- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f66800d5e60 msgr2=0x7f66801b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.156 7f6684f18700 1 --2- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f66800d5e60 0x7f66801b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f6684f18700 1 -- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66801b2a60 msgr2=0x7f66801b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f6684f18700 1 --2- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66801b2a60 0x7f66801b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f6684f18700 1 -- 172.21.15.57:0/1024340950 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800c9320 con 0x7f66800d53e0 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f6685719700 1 --2- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66801b2a60 0x7f66801b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f6684f18700 1 --2- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66800d53e0 0x7f66800d5830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f66800d7a00 tx=0x7f667000c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f667dffb700 1 -- 172.21.15.57:0/1024340950 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66800c9320 con 0x7f66800d53e0 2024-04-25T02:05:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f667dffb700 1 -- 172.21.15.57:0/1024340950 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66700072e0 con 0x7f66800d53e0 2024-04-25T02:05:51.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f668811d700 1 -- 172.21.15.57:0/1024340950 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66801b9c30 con 0x7f66800d53e0 2024-04-25T02:05:51.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f667dffb700 1 -- 172.21.15.57:0/1024340950 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6670005810 con 0x7f66800d53e0 2024-04-25T02:05:51.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f668811d700 1 -- 172.21.15.57:0/1024340950 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66801ba010 con 0x7f66800d53e0 2024-04-25T02:05:51.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f667dffb700 1 -- 172.21.15.57:0/1024340950 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6670005a10 con 0x7f66800d53e0 2024-04-25T02:05:51.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.157 7f667dffb700 1 -- 172.21.15.57:0/1024340950 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f66700148d0 con 0x7f66800d53e0 2024-04-25T02:05:51.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.158 7f668811d700 1 -- 172.21.15.57:0/1024340950 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66800c4920 con 0x7f66800d53e0 2024-04-25T02:05:51.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.161 7f667dffb700 1 -- 172.21.15.57:0/1024340950 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f66700070d0 con 0x7f66800d53e0 2024-04-25T02:05:51.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.306 7f668811d700 1 -- 172.21.15.57:0/1024340950 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f66800f0860 con 0x7f66800d53e0 2024-04-25T02:05:51.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.306 7f667dffb700 1 -- 172.21.15.57:0/1024340950 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+32987 (secure 0 0 0) 0x7f6670000c30 con 0x7f66800d53e0 2024-04-25T02:05:51.312 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:51.313 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","health":{"checks":{},"status":"HEALTH_OK"},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"14","num_mons":3},"osdmap":{"osdmap":{"epoch":16,"num_osds":4,"num_up_osds":4,"num_in_osds":4,"num_remapped_pgs":0}},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":8}],"num_pgs":136,"num_pools":3,"num_objects":0,"data_bytes":0,"bytes_used":4295426048,"bytes_avail":382251630592,"bytes_total":386547056640,"unknown_pgs_ratio":0.94117647409439087},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4215}],"up:standby":0},"mgrmap":{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6816","nonce":43033}]},"active_addr":"172.21.15.57:6816/43033","active_change":"2024-04-25 02:05:30.655410","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}},"servicemap":{"epoch":1,"modified":"0.000000","services":{}},"progress_events":{}} 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 -- 172.21.15.57:0/1024340950 >> v1:172.21.15.57:6816/43033 conn(0x7f66640145b0 legacy=0x7f6664016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 -- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66800d53e0 msgr2=0x7f66800d5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 --2- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66800d53e0 0x7f66800d5830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f66800d7a00 tx=0x7f667000c860).stop 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 -- 172.21.15.57:0/1024340950 shutdown_connections 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 --2- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f66801b2a60 0x7f66801b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 --2- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66800d53e0 0x7f66800d5830 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 --2- 172.21.15.57:0/1024340950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f66800d5e60 0x7f66801b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 -- 172.21.15.57:0/1024340950 >> 172.21.15.57:0/1024340950 conn(0x7f66800c6c70 msgr2=0x7f66800d6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 -- 172.21.15.57:0/1024340950 shutdown_connections 2024-04-25T02:05:51.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.308 7f668811d700 1 -- 172.21.15.57:0/1024340950 wait complete. 2024-04-25T02:05:51.325 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T02:05:51.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:05:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.453 7f481c7ec700 1 Processor -- start 2024-04-25T02:05:51.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.453 7f481c7ec700 1 -- start start 2024-04-25T02:05:51.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.453 7f481c7ec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140f58a0 0x7f48140f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.453 7f481c7ec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140f1e40 0x7f481410e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.453 7f481c7ec700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140f91b0 con 0x7f48140f2290 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f481c7ec700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481410f060 con 0x7f48140f58a0 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f481c7ec700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48141ac600 con 0x7f48140f1e40 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f48195e7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140f58a0 0x7f48140f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f4818de6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140f1e40 0x7f481410e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f4819de8700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f48140f2290 0x7f481410e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57546/0 (socket says 172.21.15.57:57546) 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f4819de8700 1 -- 172.21.15.57:0/858384590 learned_addr learned my addr 172.21.15.57:0/858384590 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f48195e7700 1 -- 172.21.15.57:0/858384590 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140f1e40 msgr2=0x7f481410e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f48195e7700 1 --2- 172.21.15.57:0/858384590 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140f1e40 0x7f481410e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f48195e7700 1 -- 172.21.15.57:0/858384590 >> v1:172.21.15.57:6789/0 conn(0x7f48140f2290 legacy=0x7f481410e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f4803fff700 1 -- 172.21.15.57:0/858384590 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761273075 0 0) 0x7f480c001490 con 0x7f48140f2290 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f48195e7700 1 -- 172.21.15.57:0/858384590 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48141ac7b0 con 0x7f48140f58a0 2024-04-25T02:05:51.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f4818de6700 1 --2- 172.21.15.57:0/858384590 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140f1e40 0x7f481410e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f48195e7700 1 --2- 172.21.15.57:0/858384590 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140f58a0 0x7f48140f1810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4810002f70 tx=0x7f481000ba20).ready entity=mon.1 client_cookie=da6f56501d5d9552 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f4803fff700 1 -- 172.21.15.57:0/858384590 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48141ac7b0 con 0x7f48140f58a0 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f4803fff700 1 -- 172.21.15.57:0/858384590 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000d570 con 0x7f48140f58a0 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f4803fff700 1 -- 172.21.15.57:0/858384590 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f481000d990 con 0x7f48140f58a0 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f481c7ec700 1 -- 172.21.15.57:0/858384590 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140f58a0 msgr2=0x7f48140f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.454 7f481c7ec700 1 --2- 172.21.15.57:0/858384590 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140f58a0 0x7f48140f1810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4810002f70 tx=0x7f481000ba20).stop 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.455 7f481c7ec700 1 -- 172.21.15.57:0/858384590 shutdown_connections 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.455 7f481c7ec700 1 --2- 172.21.15.57:0/858384590 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140f58a0 0x7f48140f1810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.455 7f481c7ec700 1 --2- 172.21.15.57:0/858384590 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140f1e40 0x7f481410e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.455 7f481c7ec700 1 -- 172.21.15.57:0/858384590 >> 172.21.15.57:0/858384590 conn(0x7f48141139f0 msgr2=0x7f48140f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.455 7f481c7ec700 1 -- 172.21.15.57:0/858384590 shutdown_connections 2024-04-25T02:05:51.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.455 7f481c7ec700 1 -- 172.21.15.57:0/858384590 wait complete. 2024-04-25T02:05:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.479 7f481c7ec700 1 Processor -- start 2024-04-25T02:05:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.479 7f481c7ec700 1 -- start start 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f481c7ec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140d7c20 0x7f48140d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f481c7ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48140d1dc0 0x7f48141b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f481c7ec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140d2210 0x7f48141b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f481c7ec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140c01d0 con 0x7f48140d1dc0 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f481c7ec700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48140c0560 con 0x7f48140d2210 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f481c7ec700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48141b4c70 con 0x7f48140d7c20 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140d7c20 0x7f48140d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140d7c20 0x7f48140d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60642/0 (socket says 172.21.15.57:60642) 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 -- 172.21.15.57:0/821504748 learned_addr learned my addr 172.21.15.57:0/821504748 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f4819de8700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140d2210 0x7f48141b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f4818de6700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48140d1dc0 0x7f48141b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 -- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140d2210 msgr2=0x7f48141b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140d2210 0x7f48141b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 -- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48140d1dc0 msgr2=0x7f48141b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48140d1dc0 0x7f48141b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 -- 172.21.15.57:0/821504748 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48141b4e70 con 0x7f48140d7c20 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48195e7700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140d7c20 0x7f48140d1790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f48140c0de0 tx=0x7f48100068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48027fc700 1 -- 172.21.15.57:0/821504748 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48141b4e70 con 0x7f48140d7c20 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48027fc700 1 -- 172.21.15.57:0/821504748 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4810011a20 con 0x7f48140d7c20 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f481c7ec700 1 -- 172.21.15.57:0/821504748 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48141bb790 con 0x7f48140d7c20 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.480 7f48027fc700 1 -- 172.21.15.57:0/821504748 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4810017040 con 0x7f48140d7c20 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.481 7f481c7ec700 1 -- 172.21.15.57:0/821504748 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48141bbb70 con 0x7f48140d7c20 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.481 7f48027fc700 1 -- 172.21.15.57:0/821504748 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f48100273b0 con 0x7f48140d7c20 2024-04-25T02:05:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.481 7f48027fc700 1 -- 172.21.15.57:0/821504748 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f4810018070 con 0x7f48140d7c20 2024-04-25T02:05:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.482 7f481c7ec700 1 -- 172.21.15.57:0/821504748 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48140f0860 con 0x7f48140d7c20 2024-04-25T02:05:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.485 7f48027fc700 1 -- 172.21.15.57:0/821504748 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f481000d360 con 0x7f48140d7c20 2024-04-25T02:05:51.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.591 7f481c7ec700 1 -- 172.21.15.57:0/821504748 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f4814087810 con 0x7f47f40145b0 2024-04-25T02:05:51.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.599 7f48027fc700 1 -- 172.21.15.57:0/821504748 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306153 (unknown 2965378022 0 2488207424) 0x7f480400b7c0 con 0x7f47f40145b0 2024-04-25T02:05:51.608 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:51.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 -- 172.21.15.57:0/821504748 >> v1:172.21.15.57:6816/43033 conn(0x7f47f40145b0 legacy=0x7f47f4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 -- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140d7c20 msgr2=0x7f48140d1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:51.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140d7c20 0x7f48140d1790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f48140c0de0 tx=0x7f48100068c0).stop 2024-04-25T02:05:51.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 -- 172.21.15.57:0/821504748 shutdown_connections 2024-04-25T02:05:51.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48140d2210 0x7f48141b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48140d7c20 0x7f48140d1790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 --2- 172.21.15.57:0/821504748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48140d1dc0 0x7f48141b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 -- 172.21.15.57:0/821504748 >> 172.21.15.57:0/821504748 conn(0x7f48140bd100 msgr2=0x7f48140c0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 -- 172.21.15.57:0/821504748 shutdown_connections 2024-04-25T02:05:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:51.601 7f481c7ec700 1 -- 172.21.15.57:0/821504748 wait complete. 2024-04-25T02:05:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:05:51.618 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25 02:05:50.666127","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372976","last_change":"2024-04-25 02:05:47.369320","last_active":"2024-04-25 02:05:47.372976","last_peered":"2024-04-25 02:05:47.372976","last_clean":"2024-04-25 02:05:47.372976","last_became_active":"2024-04-25 02:05:47.369008","last_became_peered":"2024-04-25 02:05:47.369008","last_unstale":"2024-04-25 02:05:47.372976","last_undegraded":"2024-04-25 02:05:47.372976","last_fullsized":"2024-04-25 02:05:47.372976","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358525","last_change":"2024-04-25 02:05:47.021686","last_active":"2024-04-25 02:05:47.358525","last_peered":"2024-04-25 02:05:47.358525","last_clean":"2024-04-25 02:05:47.358525","last_became_active":"2024-04-25 02:05:47.020938","last_became_peered":"2024-04-25 02:05:47.020938","last_unstale":"2024-04-25 02:05:47.358525","last_undegraded":"2024-04-25 02:05:47.358525","last_fullsized":"2024-04-25 02:05:47.358525","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388999","last_change":"2024-04-25 02:05:47.384312","last_active":"2024-04-25 02:05:47.388999","last_peered":"2024-04-25 02:05:47.388999","last_clean":"2024-04-25 02:05:47.388999","last_became_active":"2024-04-25 02:05:47.378585","last_became_peered":"2024-04-25 02:05:47.378585","last_unstale":"2024-04-25 02:05:47.388999","last_undegraded":"2024-04-25 02:05:47.388999","last_fullsized":"2024-04-25 02:05:47.388999","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363658","last_change":"2024-04-25 02:05:47.020533","last_active":"2024-04-25 02:05:47.363658","last_peered":"2024-04-25 02:05:47.363658","last_clean":"2024-04-25 02:05:47.363658","last_became_active":"2024-04-25 02:05:47.019990","last_became_peered":"2024-04-25 02:05:47.019990","last_unstale":"2024-04-25 02:05:47.363658","last_undegraded":"2024-04-25 02:05:47.363658","last_fullsized":"2024-04-25 02:05:47.363658","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388734","last_change":"2024-04-25 02:05:47.379801","last_active":"2024-04-25 02:05:47.388734","last_peered":"2024-04-25 02:05:47.388734","last_clean":"2024-04-25 02:05:47.388734","last_became_active":"2024-04-25 02:05:47.379321","last_became_peered":"2024-04-25 02:05:47.379321","last_unstale":"2024-04-25 02:05:47.388734","last_undegraded":"2024-04-25 02:05:47.388734","last_fullsized":"2024-04-25 02:05:47.388734","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357766","last_change":"2024-04-25 02:05:47.020828","last_active":"2024-04-25 02:05:47.357766","last_peered":"2024-04-25 02:05:47.357766","last_clean":"2024-04-25 02:05:47.357766","last_became_active":"2024-04-25 02:05:47.020320","last_became_peered":"2024-04-25 02:05:47.020320","last_unstale":"2024-04-25 02:05:47.357766","last_undegraded":"2024-04-25 02:05:47.357766","last_fullsized":"2024-04-25 02:05:47.357766","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373126","last_change":"2024-04-25 02:05:47.365068","last_active":"2024-04-25 02:05:47.373126","last_peered":"2024-04-25 02:05:47.373126","last_clean":"2024-04-25 02:05:47.373126","last_became_active":"2024-04-25 02:05:47.364768","last_became_peered":"2024-04-25 02:05:47.364768","last_unstale":"2024-04-25 02:05:47.373126","last_undegraded":"2024-04-25 02:05:47.373126","last_fullsized":"2024-04-25 02:05:47.373126","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.355780","last_change":"2024-04-25 02:05:47.028823","last_active":"2024-04-25 02:05:47.355780","last_peered":"2024-04-25 02:05:47.355780","last_clean":"2024-04-25 02:05:47.355780","last_became_active":"2024-04-25 02:05:47.027770","last_became_peered":"2024-04-25 02:05:47.027770","last_unstale":"2024-04-25 02:05:47.355780","last_undegraded":"2024-04-25 02:05:47.355780","last_fullsized":"2024-04-25 02:05:47.355780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382006","last_change":"2024-04-25 02:05:47.377307","last_active":"2024-04-25 02:05:47.382006","last_peered":"2024-04-25 02:05:47.382006","last_clean":"2024-04-25 02:05:47.382006","last_became_active":"2024-04-25 02:05:47.376546","last_became_peered":"2024-04-25 02:05:47.376546","last_unstale":"2024-04-25 02:05:47.382006","last_undegraded":"2024-04-25 02:05:47.382006","last_fullsized":"2024-04-25 02:05:47.382006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353187","last_change":"2024-04-25 02:05:46.996093","last_active":"2024-04-25 02:05:47.353187","last_peered":"2024-04-25 02:05:47.353187","last_clean":"2024-04-25 02:05:47.353187","last_became_active":"2024-04-25 02:05:46.995769","last_became_peered":"2024-04-25 02:05:46.995769","last_unstale":"2024-04-25 02:05:47.353187","last_undegraded":"2024-04-25 02:05:47.353187","last_fullsized":"2024-04-25 02:05:47.353187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390769","last_change":"2024-04-25 02:05:47.385883","last_active":"2024-04-25 02:05:47.390769","last_peered":"2024-04-25 02:05:47.390769","last_clean":"2024-04-25 02:05:47.390769","last_became_active":"2024-04-25 02:05:47.385568","last_became_peered":"2024-04-25 02:05:47.385568","last_unstale":"2024-04-25 02:05:47.390769","last_undegraded":"2024-04-25 02:05:47.390769","last_fullsized":"2024-04-25 02:05:47.390769","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362579","last_change":"2024-04-25 02:05:47.006764","last_active":"2024-04-25 02:05:47.362579","last_peered":"2024-04-25 02:05:47.362579","last_clean":"2024-04-25 02:05:47.362579","last_became_active":"2024-04-25 02:05:47.006519","last_became_peered":"2024-04-25 02:05:47.006519","last_unstale":"2024-04-25 02:05:47.362579","last_undegraded":"2024-04-25 02:05:47.362579","last_fullsized":"2024-04-25 02:05:47.362579","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391008","last_change":"2024-04-25 02:05:47.385392","last_active":"2024-04-25 02:05:47.391008","last_peered":"2024-04-25 02:05:47.391008","last_clean":"2024-04-25 02:05:47.391008","last_became_active":"2024-04-25 02:05:47.385092","last_became_peered":"2024-04-25 02:05:47.385092","last_unstale":"2024-04-25 02:05:47.391008","last_undegraded":"2024-04-25 02:05:47.391008","last_fullsized":"2024-04-25 02:05:47.391008","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387246","last_change":"2024-04-25 02:05:47.003242","last_active":"2024-04-25 02:05:47.387246","last_peered":"2024-04-25 02:05:47.387246","last_clean":"2024-04-25 02:05:47.387246","last_became_active":"2024-04-25 02:05:47.002466","last_became_peered":"2024-04-25 02:05:47.002466","last_unstale":"2024-04-25 02:05:47.387246","last_undegraded":"2024-04-25 02:05:47.387246","last_fullsized":"2024-04-25 02:05:47.387246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390926","last_change":"2024-04-25 02:05:47.387162","last_active":"2024-04-25 02:05:47.390926","last_peered":"2024-04-25 02:05:47.390926","last_clean":"2024-04-25 02:05:47.390926","last_became_active":"2024-04-25 02:05:47.386846","last_became_peered":"2024-04-25 02:05:47.386846","last_unstale":"2024-04-25 02:05:47.390926","last_undegraded":"2024-04-25 02:05:47.390926","last_fullsized":"2024-04-25 02:05:47.390926","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390398","last_change":"2024-04-25 02:05:47.012882","last_active":"2024-04-25 02:05:47.390398","last_peered":"2024-04-25 02:05:47.390398","last_clean":"2024-04-25 02:05:47.390398","last_became_active":"2024-04-25 02:05:47.012356","last_became_peered":"2024-04-25 02:05:47.012356","last_unstale":"2024-04-25 02:05:47.390398","last_undegraded":"2024-04-25 02:05:47.390398","last_fullsized":"2024-04-25 02:05:47.390398","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.381620","last_change":"2024-04-25 02:05:47.376840","last_active":"2024-04-25 02:05:47.381620","last_peered":"2024-04-25 02:05:47.381620","last_clean":"2024-04-25 02:05:47.381620","last_became_active":"2024-04-25 02:05:47.376550","last_became_peered":"2024-04-25 02:05:47.376550","last_unstale":"2024-04-25 02:05:47.381620","last_undegraded":"2024-04-25 02:05:47.381620","last_fullsized":"2024-04-25 02:05:47.381620","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390373","last_change":"2024-04-25 02:05:47.013902","last_active":"2024-04-25 02:05:47.390373","last_peered":"2024-04-25 02:05:47.390373","last_clean":"2024-04-25 02:05:47.390373","last_became_active":"2024-04-25 02:05:47.013571","last_became_peered":"2024-04-25 02:05:47.013571","last_unstale":"2024-04-25 02:05:47.390373","last_undegraded":"2024-04-25 02:05:47.390373","last_fullsized":"2024-04-25 02:05:47.390373","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391228","last_change":"2024-04-25 02:05:47.388939","last_active":"2024-04-25 02:05:47.391228","last_peered":"2024-04-25 02:05:47.391228","last_clean":"2024-04-25 02:05:47.391228","last_became_active":"2024-04-25 02:05:47.388673","last_became_peered":"2024-04-25 02:05:47.388673","last_unstale":"2024-04-25 02:05:47.391228","last_undegraded":"2024-04-25 02:05:47.391228","last_fullsized":"2024-04-25 02:05:47.391228","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363555","last_change":"2024-04-25 02:05:47.016797","last_active":"2024-04-25 02:05:47.363555","last_peered":"2024-04-25 02:05:47.363555","last_clean":"2024-04-25 02:05:47.363555","last_became_active":"2024-04-25 02:05:47.016484","last_became_peered":"2024-04-25 02:05:47.016484","last_unstale":"2024-04-25 02:05:47.363555","last_undegraded":"2024-04-25 02:05:47.363555","last_fullsized":"2024-04-25 02:05:47.363555","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373750","last_change":"2024-04-25 02:05:47.363022","last_active":"2024-04-25 02:05:47.373750","last_peered":"2024-04-25 02:05:47.373750","last_clean":"2024-04-25 02:05:47.373750","last_became_active":"2024-04-25 02:05:47.362681","last_became_peered":"2024-04-25 02:05:47.362681","last_unstale":"2024-04-25 02:05:47.373750","last_undegraded":"2024-04-25 02:05:47.373750","last_fullsized":"2024-04-25 02:05:47.373750","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360184","last_change":"2024-04-25 02:05:47.012986","last_active":"2024-04-25 02:05:47.360184","last_peered":"2024-04-25 02:05:47.360184","last_clean":"2024-04-25 02:05:47.360184","last_became_active":"2024-04-25 02:05:47.012673","last_became_peered":"2024-04-25 02:05:47.012673","last_unstale":"2024-04-25 02:05:47.360184","last_undegraded":"2024-04-25 02:05:47.360184","last_fullsized":"2024-04-25 02:05:47.360184","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388639","last_change":"2024-04-25 02:05:47.378766","last_active":"2024-04-25 02:05:47.388639","last_peered":"2024-04-25 02:05:47.388639","last_clean":"2024-04-25 02:05:47.388639","last_became_active":"2024-04-25 02:05:47.376368","last_became_peered":"2024-04-25 02:05:47.376368","last_unstale":"2024-04-25 02:05:47.388639","last_undegraded":"2024-04-25 02:05:47.388639","last_fullsized":"2024-04-25 02:05:47.388639","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386504","last_change":"2024-04-25 02:05:47.003903","last_active":"2024-04-25 02:05:47.386504","last_peered":"2024-04-25 02:05:47.386504","last_clean":"2024-04-25 02:05:47.386504","last_became_active":"2024-04-25 02:05:47.003584","last_became_peered":"2024-04-25 02:05:47.003584","last_unstale":"2024-04-25 02:05:47.386504","last_undegraded":"2024-04-25 02:05:47.386504","last_fullsized":"2024-04-25 02:05:47.386504","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391545","last_change":"2024-04-25 02:05:47.382468","last_active":"2024-04-25 02:05:47.391545","last_peered":"2024-04-25 02:05:47.391545","last_clean":"2024-04-25 02:05:47.391545","last_became_active":"2024-04-25 02:05:47.382161","last_became_peered":"2024-04-25 02:05:47.382161","last_unstale":"2024-04-25 02:05:47.391545","last_undegraded":"2024-04-25 02:05:47.391545","last_fullsized":"2024-04-25 02:05:47.391545","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380007","last_change":"2024-04-25 02:05:47.014185","last_active":"2024-04-25 02:05:47.380007","last_peered":"2024-04-25 02:05:47.380007","last_clean":"2024-04-25 02:05:47.380007","last_became_active":"2024-04-25 02:05:47.013874","last_became_peered":"2024-04-25 02:05:47.013874","last_unstale":"2024-04-25 02:05:47.380007","last_undegraded":"2024-04-25 02:05:47.380007","last_fullsized":"2024-04-25 02:05:47.380007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383613","last_change":"2024-04-25 02:05:47.375244","last_active":"2024-04-25 02:05:47.383613","last_peered":"2024-04-25 02:05:47.383613","last_clean":"2024-04-25 02:05:47.383613","last_became_active":"2024-04-25 02:05:47.374904","last_became_peered":"2024-04-25 02:05:47.374904","last_unstale":"2024-04-25 02:05:47.383613","last_undegraded":"2024-04-25 02:05:47.383613","last_fullsized":"2024-04-25 02:05:47.383613","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391628","last_change":"2024-04-25 02:05:47.013961","last_active":"2024-04-25 02:05:47.391628","last_peered":"2024-04-25 02:05:47.391628","last_clean":"2024-04-25 02:05:47.391628","last_became_active":"2024-04-25 02:05:47.013634","last_became_peered":"2024-04-25 02:05:47.013634","last_unstale":"2024-04-25 02:05:47.391628","last_undegraded":"2024-04-25 02:05:47.391628","last_fullsized":"2024-04-25 02:05:47.391628","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387497","last_change":"2024-04-25 02:05:47.380961","last_active":"2024-04-25 02:05:47.387497","last_peered":"2024-04-25 02:05:47.387497","last_clean":"2024-04-25 02:05:47.387497","last_became_active":"2024-04-25 02:05:47.380213","last_became_peered":"2024-04-25 02:05:47.380213","last_unstale":"2024-04-25 02:05:47.387497","last_undegraded":"2024-04-25 02:05:47.387497","last_fullsized":"2024-04-25 02:05:47.387497","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353098","last_change":"2024-04-25 02:05:47.002799","last_active":"2024-04-25 02:05:47.353098","last_peered":"2024-04-25 02:05:47.353098","last_clean":"2024-04-25 02:05:47.353098","last_became_active":"2024-04-25 02:05:47.002131","last_became_peered":"2024-04-25 02:05:47.002131","last_unstale":"2024-04-25 02:05:47.353098","last_undegraded":"2024-04-25 02:05:47.353098","last_fullsized":"2024-04-25 02:05:47.353098","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386374","last_change":"2024-04-25 02:05:47.372655","last_active":"2024-04-25 02:05:47.386374","last_peered":"2024-04-25 02:05:47.386374","last_clean":"2024-04-25 02:05:47.386374","last_became_active":"2024-04-25 02:05:47.372344","last_became_peered":"2024-04-25 02:05:47.372344","last_unstale":"2024-04-25 02:05:47.386374","last_undegraded":"2024-04-25 02:05:47.386374","last_fullsized":"2024-04-25 02:05:47.386374","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352064","last_change":"2024-04-25 02:05:46.999849","last_active":"2024-04-25 02:05:47.352064","last_peered":"2024-04-25 02:05:47.352064","last_clean":"2024-04-25 02:05:47.352064","last_became_active":"2024-04-25 02:05:46.999494","last_became_peered":"2024-04-25 02:05:46.999494","last_unstale":"2024-04-25 02:05:47.352064","last_undegraded":"2024-04-25 02:05:47.352064","last_fullsized":"2024-04-25 02:05:47.352064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388549","last_change":"2024-04-25 02:05:47.377522","last_active":"2024-04-25 02:05:47.388549","last_peered":"2024-04-25 02:05:47.388549","last_clean":"2024-04-25 02:05:47.388549","last_became_active":"2024-04-25 02:05:47.374641","last_became_peered":"2024-04-25 02:05:47.374641","last_unstale":"2024-04-25 02:05:47.388549","last_undegraded":"2024-04-25 02:05:47.388549","last_fullsized":"2024-04-25 02:05:47.388549","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389608","last_change":"2024-04-25 02:05:47.017557","last_active":"2024-04-25 02:05:47.389608","last_peered":"2024-04-25 02:05:47.389608","last_clean":"2024-04-25 02:05:47.389608","last_became_active":"2024-04-25 02:05:47.017189","last_became_peered":"2024-04-25 02:05:47.017189","last_unstale":"2024-04-25 02:05:47.389608","last_undegraded":"2024-04-25 02:05:47.389608","last_fullsized":"2024-04-25 02:05:47.389608","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389984","last_change":"2024-04-25 02:05:47.386122","last_active":"2024-04-25 02:05:47.389984","last_peered":"2024-04-25 02:05:47.389984","last_clean":"2024-04-25 02:05:47.389984","last_became_active":"2024-04-25 02:05:47.385756","last_became_peered":"2024-04-25 02:05:47.385756","last_unstale":"2024-04-25 02:05:47.389984","last_undegraded":"2024-04-25 02:05:47.389984","last_fullsized":"2024-04-25 02:05:47.389984","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352989","last_change":"2024-04-25 02:05:47.019790","last_active":"2024-04-25 02:05:47.352989","last_peered":"2024-04-25 02:05:47.352989","last_clean":"2024-04-25 02:05:47.352989","last_became_active":"2024-04-25 02:05:47.019471","last_became_peered":"2024-04-25 02:05:47.019471","last_unstale":"2024-04-25 02:05:47.352989","last_undegraded":"2024-04-25 02:05:47.352989","last_fullsized":"2024-04-25 02:05:47.352989","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389192","last_change":"2024-04-25 02:05:47.380774","last_active":"2024-04-25 02:05:47.389192","last_peered":"2024-04-25 02:05:47.389192","last_clean":"2024-04-25 02:05:47.389192","last_became_active":"2024-04-25 02:05:47.380517","last_became_peered":"2024-04-25 02:05:47.380517","last_unstale":"2024-04-25 02:05:47.389192","last_undegraded":"2024-04-25 02:05:47.389192","last_fullsized":"2024-04-25 02:05:47.389192","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352014","last_change":"2024-04-25 02:05:47.005189","last_active":"2024-04-25 02:05:47.352014","last_peered":"2024-04-25 02:05:47.352014","last_clean":"2024-04-25 02:05:47.352014","last_became_active":"2024-04-25 02:05:47.004657","last_became_peered":"2024-04-25 02:05:47.004657","last_unstale":"2024-04-25 02:05:47.352014","last_undegraded":"2024-04-25 02:05:47.352014","last_fullsized":"2024-04-25 02:05:47.352014","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388617","last_change":"2024-04-25 02:05:47.377256","last_active":"2024-04-25 02:05:47.388617","last_peered":"2024-04-25 02:05:47.388617","last_clean":"2024-04-25 02:05:47.388617","last_became_active":"2024-04-25 02:05:47.376589","last_became_peered":"2024-04-25 02:05:47.376589","last_unstale":"2024-04-25 02:05:47.388617","last_undegraded":"2024-04-25 02:05:47.388617","last_fullsized":"2024-04-25 02:05:47.388617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359016","last_change":"2024-04-25 02:05:46.994018","last_active":"2024-04-25 02:05:47.359016","last_peered":"2024-04-25 02:05:47.359016","last_clean":"2024-04-25 02:05:47.359016","last_became_active":"2024-04-25 02:05:46.993698","last_became_peered":"2024-04-25 02:05:46.993698","last_unstale":"2024-04-25 02:05:47.359016","last_undegraded":"2024-04-25 02:05:47.359016","last_fullsized":"2024-04-25 02:05:47.359016","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389233","last_change":"2024-04-25 02:05:47.382653","last_active":"2024-04-25 02:05:47.389233","last_peered":"2024-04-25 02:05:47.389233","last_clean":"2024-04-25 02:05:47.389233","last_became_active":"2024-04-25 02:05:47.382376","last_became_peered":"2024-04-25 02:05:47.382376","last_unstale":"2024-04-25 02:05:47.389233","last_undegraded":"2024-04-25 02:05:47.389233","last_fullsized":"2024-04-25 02:05:47.389233","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352520","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:05:47.352520","last_peered":"2024-04-25 02:05:47.352520","last_clean":"2024-04-25 02:05:47.352520","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:05:47.352520","last_undegraded":"2024-04-25 02:05:47.352520","last_fullsized":"2024-04-25 02:05:47.352520","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353532","last_change":"2024-04-25 02:05:47.001851","last_active":"2024-04-25 02:05:47.353532","last_peered":"2024-04-25 02:05:47.353532","last_clean":"2024-04-25 02:05:47.353532","last_became_active":"2024-04-25 02:05:47.001503","last_became_peered":"2024-04-25 02:05:47.001503","last_unstale":"2024-04-25 02:05:47.353532","last_undegraded":"2024-04-25 02:05:47.353532","last_fullsized":"2024-04-25 02:05:47.353532","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384277","last_change":"2024-04-25 02:05:47.378248","last_active":"2024-04-25 02:05:47.384277","last_peered":"2024-04-25 02:05:47.384277","last_clean":"2024-04-25 02:05:47.384277","last_became_active":"2024-04-25 02:05:47.377943","last_became_peered":"2024-04-25 02:05:47.377943","last_unstale":"2024-04-25 02:05:47.384277","last_undegraded":"2024-04-25 02:05:47.384277","last_fullsized":"2024-04-25 02:05:47.384277","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360052","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:05:47.360052","last_peered":"2024-04-25 02:05:47.360052","last_clean":"2024-04-25 02:05:47.360052","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:05:47.360052","last_undegraded":"2024-04-25 02:05:47.360052","last_fullsized":"2024-04-25 02:05:47.360052","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388406","last_change":"2024-04-25 02:05:47.021725","last_active":"2024-04-25 02:05:47.388406","last_peered":"2024-04-25 02:05:47.388406","last_clean":"2024-04-25 02:05:47.388406","last_became_active":"2024-04-25 02:05:47.021378","last_became_peered":"2024-04-25 02:05:47.021378","last_unstale":"2024-04-25 02:05:47.388406","last_undegraded":"2024-04-25 02:05:47.388406","last_fullsized":"2024-04-25 02:05:47.388406","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352584","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:05:47.352584","last_peered":"2024-04-25 02:05:47.352584","last_clean":"2024-04-25 02:05:47.352584","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:05:47.352584","last_undegraded":"2024-04-25 02:05:47.352584","last_fullsized":"2024-04-25 02:05:47.352584","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356151","last_change":"2024-04-25 02:05:47.028109","last_active":"2024-04-25 02:05:47.356151","last_peered":"2024-04-25 02:05:47.356151","last_clean":"2024-04-25 02:05:47.356151","last_became_active":"2024-04-25 02:05:47.026998","last_became_peered":"2024-04-25 02:05:47.026998","last_unstale":"2024-04-25 02:05:47.356151","last_undegraded":"2024-04-25 02:05:47.356151","last_fullsized":"2024-04-25 02:05:47.356151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388917","last_change":"2024-04-25 02:05:47.384104","last_active":"2024-04-25 02:05:47.388917","last_peered":"2024-04-25 02:05:47.388917","last_clean":"2024-04-25 02:05:47.388917","last_became_active":"2024-04-25 02:05:47.383783","last_became_peered":"2024-04-25 02:05:47.383783","last_unstale":"2024-04-25 02:05:47.388917","last_undegraded":"2024-04-25 02:05:47.388917","last_fullsized":"2024-04-25 02:05:47.388917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360990","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:05:47.360990","last_peered":"2024-04-25 02:05:47.360990","last_clean":"2024-04-25 02:05:47.360990","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:05:47.360990","last_undegraded":"2024-04-25 02:05:47.360990","last_fullsized":"2024-04-25 02:05:47.360990","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351208","last_change":"2024-04-25 02:05:47.013050","last_active":"2024-04-25 02:05:47.351208","last_peered":"2024-04-25 02:05:47.351208","last_clean":"2024-04-25 02:05:47.351208","last_became_active":"2024-04-25 02:05:47.012558","last_became_peered":"2024-04-25 02:05:47.012558","last_unstale":"2024-04-25 02:05:47.351208","last_undegraded":"2024-04-25 02:05:47.351208","last_fullsized":"2024-04-25 02:05:47.351208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373782","last_change":"2024-04-25 02:05:47.363093","last_active":"2024-04-25 02:05:47.373782","last_peered":"2024-04-25 02:05:47.373782","last_clean":"2024-04-25 02:05:47.373782","last_became_active":"2024-04-25 02:05:47.362753","last_became_peered":"2024-04-25 02:05:47.362753","last_unstale":"2024-04-25 02:05:47.373782","last_undegraded":"2024-04-25 02:05:47.373782","last_fullsized":"2024-04-25 02:05:47.373782","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352385","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:05:47.352385","last_peered":"2024-04-25 02:05:47.352385","last_clean":"2024-04-25 02:05:47.352385","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:05:47.352385","last_undegraded":"2024-04-25 02:05:47.352385","last_fullsized":"2024-04-25 02:05:47.352385","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356625","last_change":"2024-04-25 02:05:47.018087","last_active":"2024-04-25 02:05:47.356625","last_peered":"2024-04-25 02:05:47.356625","last_clean":"2024-04-25 02:05:47.356625","last_became_active":"2024-04-25 02:05:47.017799","last_became_peered":"2024-04-25 02:05:47.017799","last_unstale":"2024-04-25 02:05:47.356625","last_undegraded":"2024-04-25 02:05:47.356625","last_fullsized":"2024-04-25 02:05:47.356625","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387244","last_change":"2024-04-25 02:05:47.375657","last_active":"2024-04-25 02:05:47.387244","last_peered":"2024-04-25 02:05:47.387244","last_clean":"2024-04-25 02:05:47.387244","last_became_active":"2024-04-25 02:05:47.375334","last_became_peered":"2024-04-25 02:05:47.375334","last_unstale":"2024-04-25 02:05:47.387244","last_undegraded":"2024-04-25 02:05:47.387244","last_fullsized":"2024-04-25 02:05:47.387244","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357499","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:05:47.357499","last_peered":"2024-04-25 02:05:47.357499","last_clean":"2024-04-25 02:05:47.357499","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:05:47.357499","last_undegraded":"2024-04-25 02:05:47.357499","last_fullsized":"2024-04-25 02:05:47.357499","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358000","last_change":"2024-04-25 02:05:47.029097","last_active":"2024-04-25 02:05:47.358000","last_peered":"2024-04-25 02:05:47.358000","last_clean":"2024-04-25 02:05:47.358000","last_became_active":"2024-04-25 02:05:47.025880","last_became_peered":"2024-04-25 02:05:47.025880","last_unstale":"2024-04-25 02:05:47.358000","last_undegraded":"2024-04-25 02:05:47.358000","last_fullsized":"2024-04-25 02:05:47.358000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390611","last_change":"2024-04-25 02:05:47.384976","last_active":"2024-04-25 02:05:47.390611","last_peered":"2024-04-25 02:05:47.390611","last_clean":"2024-04-25 02:05:47.390611","last_became_active":"2024-04-25 02:05:47.384672","last_became_peered":"2024-04-25 02:05:47.384672","last_unstale":"2024-04-25 02:05:47.390611","last_undegraded":"2024-04-25 02:05:47.390611","last_fullsized":"2024-04-25 02:05:47.390611","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360865","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:05:47.360865","last_peered":"2024-04-25 02:05:47.360865","last_clean":"2024-04-25 02:05:47.360865","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:05:47.360865","last_undegraded":"2024-04-25 02:05:47.360865","last_fullsized":"2024-04-25 02:05:47.360865","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359901","last_change":"2024-04-25 02:05:47.026109","last_active":"2024-04-25 02:05:47.359901","last_peered":"2024-04-25 02:05:47.359901","last_clean":"2024-04-25 02:05:47.359901","last_became_active":"2024-04-25 02:05:47.025764","last_became_peered":"2024-04-25 02:05:47.025764","last_unstale":"2024-04-25 02:05:47.359901","last_undegraded":"2024-04-25 02:05:47.359901","last_fullsized":"2024-04-25 02:05:47.359901","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382178","last_change":"2024-04-25 02:05:47.377843","last_active":"2024-04-25 02:05:47.382178","last_peered":"2024-04-25 02:05:47.382178","last_clean":"2024-04-25 02:05:47.382178","last_became_active":"2024-04-25 02:05:47.377538","last_became_peered":"2024-04-25 02:05:47.377538","last_unstale":"2024-04-25 02:05:47.382178","last_undegraded":"2024-04-25 02:05:47.382178","last_fullsized":"2024-04-25 02:05:47.382178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352612","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:05:47.352612","last_peered":"2024-04-25 02:05:47.352612","last_clean":"2024-04-25 02:05:47.352612","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:05:47.352612","last_undegraded":"2024-04-25 02:05:47.352612","last_fullsized":"2024-04-25 02:05:47.352612","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354313","last_change":"2024-04-25 02:05:47.004781","last_active":"2024-04-25 02:05:47.354313","last_peered":"2024-04-25 02:05:47.354313","last_clean":"2024-04-25 02:05:47.354313","last_became_active":"2024-04-25 02:05:47.004453","last_became_peered":"2024-04-25 02:05:47.004453","last_unstale":"2024-04-25 02:05:47.354313","last_undegraded":"2024-04-25 02:05:47.354313","last_fullsized":"2024-04-25 02:05:47.354313","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380248","last_change":"2024-04-25 02:05:47.376611","last_active":"2024-04-25 02:05:47.380248","last_peered":"2024-04-25 02:05:47.380248","last_clean":"2024-04-25 02:05:47.380248","last_became_active":"2024-04-25 02:05:47.376284","last_became_peered":"2024-04-25 02:05:47.376284","last_unstale":"2024-04-25 02:05:47.380248","last_undegraded":"2024-04-25 02:05:47.380248","last_fullsized":"2024-04-25 02:05:47.380248","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389945","last_change":"2024-04-25 02:05:47.387545","last_active":"2024-04-25 02:05:47.389945","last_peered":"2024-04-25 02:05:47.389945","last_clean":"2024-04-25 02:05:47.389945","last_became_active":"2024-04-25 02:05:47.387246","last_became_peered":"2024-04-25 02:05:47.387246","last_unstale":"2024-04-25 02:05:47.389945","last_undegraded":"2024-04-25 02:05:47.389945","last_fullsized":"2024-04-25 02:05:47.389945","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361706","last_change":"2024-04-25 02:05:47.006606","last_active":"2024-04-25 02:05:47.361706","last_peered":"2024-04-25 02:05:47.361706","last_clean":"2024-04-25 02:05:47.361706","last_became_active":"2024-04-25 02:05:47.006296","last_became_peered":"2024-04-25 02:05:47.006296","last_unstale":"2024-04-25 02:05:47.361706","last_undegraded":"2024-04-25 02:05:47.361706","last_fullsized":"2024-04-25 02:05:47.361706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387972","last_change":"2024-04-25 02:05:47.381933","last_active":"2024-04-25 02:05:47.387972","last_peered":"2024-04-25 02:05:47.387972","last_clean":"2024-04-25 02:05:47.387972","last_became_active":"2024-04-25 02:05:47.379588","last_became_peered":"2024-04-25 02:05:47.379588","last_unstale":"2024-04-25 02:05:47.387972","last_undegraded":"2024-04-25 02:05:47.387972","last_fullsized":"2024-04-25 02:05:47.387972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378078","last_change":"2024-04-25 02:05:47.008840","last_active":"2024-04-25 02:05:47.378078","last_peered":"2024-04-25 02:05:47.378078","last_clean":"2024-04-25 02:05:47.378078","last_became_active":"2024-04-25 02:05:47.008521","last_became_peered":"2024-04-25 02:05:47.008521","last_unstale":"2024-04-25 02:05:47.378078","last_undegraded":"2024-04-25 02:05:47.378078","last_fullsized":"2024-04-25 02:05:47.378078","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385090","last_change":"2024-04-25 02:05:47.378449","last_active":"2024-04-25 02:05:47.385090","last_peered":"2024-04-25 02:05:47.385090","last_clean":"2024-04-25 02:05:47.385090","last_became_active":"2024-04-25 02:05:47.371394","last_became_peered":"2024-04-25 02:05:47.371394","last_unstale":"2024-04-25 02:05:47.385090","last_undegraded":"2024-04-25 02:05:47.385090","last_fullsized":"2024-04-25 02:05:47.385090","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389698","last_change":"2024-04-25 02:05:47.021735","last_active":"2024-04-25 02:05:47.389698","last_peered":"2024-04-25 02:05:47.389698","last_clean":"2024-04-25 02:05:47.389698","last_became_active":"2024-04-25 02:05:47.021400","last_became_peered":"2024-04-25 02:05:47.021400","last_unstale":"2024-04-25 02:05:47.389698","last_undegraded":"2024-04-25 02:05:47.389698","last_fullsized":"2024-04-25 02:05:47.389698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389987","last_change":"2024-04-25 02:05:47.383033","last_active":"2024-04-25 02:05:47.389987","last_peered":"2024-04-25 02:05:47.389987","last_clean":"2024-04-25 02:05:47.389987","last_became_active":"2024-04-25 02:05:47.382717","last_became_peered":"2024-04-25 02:05:47.382717","last_unstale":"2024-04-25 02:05:47.389987","last_undegraded":"2024-04-25 02:05:47.389987","last_fullsized":"2024-04-25 02:05:47.389987","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389376","last_change":"2024-04-25 02:05:47.014112","last_active":"2024-04-25 02:05:47.389376","last_peered":"2024-04-25 02:05:47.389376","last_clean":"2024-04-25 02:05:47.389376","last_became_active":"2024-04-25 02:05:47.013624","last_became_peered":"2024-04-25 02:05:47.013624","last_unstale":"2024-04-25 02:05:47.389376","last_undegraded":"2024-04-25 02:05:47.389376","last_fullsized":"2024-04-25 02:05:47.389376","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380606","last_change":"2024-04-25 02:05:47.373843","last_active":"2024-04-25 02:05:47.380606","last_peered":"2024-04-25 02:05:47.380606","last_clean":"2024-04-25 02:05:47.380606","last_became_active":"2024-04-25 02:05:47.369284","last_became_peered":"2024-04-25 02:05:47.369284","last_unstale":"2024-04-25 02:05:47.380606","last_undegraded":"2024-04-25 02:05:47.380606","last_fullsized":"2024-04-25 02:05:47.380606","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356604","last_change":"2024-04-25 02:05:47.028330","last_active":"2024-04-25 02:05:47.356604","last_peered":"2024-04-25 02:05:47.356604","last_clean":"2024-04-25 02:05:47.356604","last_became_active":"2024-04-25 02:05:47.027257","last_became_peered":"2024-04-25 02:05:47.027257","last_unstale":"2024-04-25 02:05:47.356604","last_undegraded":"2024-04-25 02:05:47.356604","last_fullsized":"2024-04-25 02:05:47.356604","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.375879","last_change":"2024-04-25 02:05:47.366400","last_active":"2024-04-25 02:05:47.375879","last_peered":"2024-04-25 02:05:47.375879","last_clean":"2024-04-25 02:05:47.375879","last_became_active":"2024-04-25 02:05:47.366000","last_became_peered":"2024-04-25 02:05:47.366000","last_unstale":"2024-04-25 02:05:47.375879","last_undegraded":"2024-04-25 02:05:47.375879","last_fullsized":"2024-04-25 02:05:47.375879","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351200","last_change":"2024-04-25 02:05:46.999953","last_active":"2024-04-25 02:05:47.351200","last_peered":"2024-04-25 02:05:47.351200","last_clean":"2024-04-25 02:05:47.351200","last_became_active":"2024-04-25 02:05:46.999606","last_became_peered":"2024-04-25 02:05:46.999606","last_unstale":"2024-04-25 02:05:47.351200","last_undegraded":"2024-04-25 02:05:47.351200","last_fullsized":"2024-04-25 02:05:47.351200","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387617","last_change":"2024-04-25 02:05:47.381525","last_active":"2024-04-25 02:05:47.387617","last_peered":"2024-04-25 02:05:47.387617","last_clean":"2024-04-25 02:05:47.387617","last_became_active":"2024-04-25 02:05:47.378390","last_became_peered":"2024-04-25 02:05:47.378390","last_unstale":"2024-04-25 02:05:47.387617","last_undegraded":"2024-04-25 02:05:47.387617","last_fullsized":"2024-04-25 02:05:47.387617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363760","last_change":"2024-04-25 02:05:47.026754","last_active":"2024-04-25 02:05:47.363760","last_peered":"2024-04-25 02:05:47.363760","last_clean":"2024-04-25 02:05:47.363760","last_became_active":"2024-04-25 02:05:47.026391","last_became_peered":"2024-04-25 02:05:47.026391","last_unstale":"2024-04-25 02:05:47.363760","last_undegraded":"2024-04-25 02:05:47.363760","last_fullsized":"2024-04-25 02:05:47.363760","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388695","last_change":"2024-04-25 02:05:47.379347","last_active":"2024-04-25 02:05:47.388695","last_peered":"2024-04-25 02:05:47.388695","last_clean":"2024-04-25 02:05:47.388695","last_became_active":"2024-04-25 02:05:47.379040","last_became_peered":"2024-04-25 02:05:47.379040","last_unstale":"2024-04-25 02:05:47.388695","last_undegraded":"2024-04-25 02:05:47.388695","last_fullsized":"2024-04-25 02:05:47.388695","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358961","last_change":"2024-04-25 02:05:47.027710","last_active":"2024-04-25 02:05:47.358961","last_peered":"2024-04-25 02:05:47.358961","last_clean":"2024-04-25 02:05:47.358961","last_became_active":"2024-04-25 02:05:47.027316","last_became_peered":"2024-04-25 02:05:47.027316","last_unstale":"2024-04-25 02:05:47.358961","last_undegraded":"2024-04-25 02:05:47.358961","last_fullsized":"2024-04-25 02:05:47.358961","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374780","last_change":"2024-04-25 02:05:47.372923","last_active":"2024-04-25 02:05:47.374780","last_peered":"2024-04-25 02:05:47.374780","last_clean":"2024-04-25 02:05:47.374780","last_became_active":"2024-04-25 02:05:47.372581","last_became_peered":"2024-04-25 02:05:47.372581","last_unstale":"2024-04-25 02:05:47.374780","last_undegraded":"2024-04-25 02:05:47.374780","last_fullsized":"2024-04-25 02:05:47.374780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354411","last_change":"2024-04-25 02:05:47.004609","last_active":"2024-04-25 02:05:47.354411","last_peered":"2024-04-25 02:05:47.354411","last_clean":"2024-04-25 02:05:47.354411","last_became_active":"2024-04-25 02:05:47.001832","last_became_peered":"2024-04-25 02:05:47.001832","last_unstale":"2024-04-25 02:05:47.354411","last_undegraded":"2024-04-25 02:05:47.354411","last_fullsized":"2024-04-25 02:05:47.354411","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390986","last_change":"2024-04-25 02:05:47.380256","last_active":"2024-04-25 02:05:47.390986","last_peered":"2024-04-25 02:05:47.390986","last_clean":"2024-04-25 02:05:47.390986","last_became_active":"2024-04-25 02:05:47.379963","last_became_peered":"2024-04-25 02:05:47.379963","last_unstale":"2024-04-25 02:05:47.390986","last_undegraded":"2024-04-25 02:05:47.390986","last_fullsized":"2024-04-25 02:05:47.390986","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352630","last_change":"2024-04-25 02:05:46.996348","last_active":"2024-04-25 02:05:47.352630","last_peered":"2024-04-25 02:05:47.352630","last_clean":"2024-04-25 02:05:47.352630","last_became_active":"2024-04-25 02:05:46.996069","last_became_peered":"2024-04-25 02:05:46.996069","last_unstale":"2024-04-25 02:05:47.352630","last_undegraded":"2024-04-25 02:05:47.352630","last_fullsized":"2024-04-25 02:05:47.352630","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389206","last_change":"2024-04-25 02:05:47.382589","last_active":"2024-04-25 02:05:47.389206","last_peered":"2024-04-25 02:05:47.389206","last_clean":"2024-04-25 02:05:47.389206","last_became_active":"2024-04-25 02:05:47.382307","last_became_peered":"2024-04-25 02:05:47.382307","last_unstale":"2024-04-25 02:05:47.389206","last_undegraded":"2024-04-25 02:05:47.389206","last_fullsized":"2024-04-25 02:05:47.389206","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-04-25 02:05:48.371682","last_change":"2024-04-25 02:05:46.999274","last_active":"2024-04-25 02:05:48.371682","last_peered":"2024-04-25 02:05:48.371682","last_clean":"2024-04-25 02:05:48.371682","last_became_active":"2024-04-25 02:05:46.998876","last_became_peered":"2024-04-25 02:05:46.998876","last_unstale":"2024-04-25 02:05:48.371682","last_undegraded":"2024-04-25 02:05:48.371682","last_fullsized":"2024-04-25 02:05:48.371682","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382025","last_change":"2024-04-25 02:05:47.377487","last_active":"2024-04-25 02:05:47.382025","last_peered":"2024-04-25 02:05:47.382025","last_clean":"2024-04-25 02:05:47.382025","last_became_active":"2024-04-25 02:05:47.376770","last_became_peered":"2024-04-25 02:05:47.376770","last_unstale":"2024-04-25 02:05:47.382025","last_undegraded":"2024-04-25 02:05:47.382025","last_fullsized":"2024-04-25 02:05:47.382025","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361361","last_change":"2024-04-25 02:05:47.026964","last_active":"2024-04-25 02:05:47.361361","last_peered":"2024-04-25 02:05:47.361361","last_clean":"2024-04-25 02:05:47.361361","last_became_active":"2024-04-25 02:05:47.026604","last_became_peered":"2024-04-25 02:05:47.026604","last_unstale":"2024-04-25 02:05:47.361361","last_undegraded":"2024-04-25 02:05:47.361361","last_fullsized":"2024-04-25 02:05:47.361361","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386703","last_change":"2024-04-25 02:05:47.375591","last_active":"2024-04-25 02:05:47.386703","last_peered":"2024-04-25 02:05:47.386703","last_clean":"2024-04-25 02:05:47.386703","last_became_active":"2024-04-25 02:05:47.375271","last_became_peered":"2024-04-25 02:05:47.375271","last_unstale":"2024-04-25 02:05:47.386703","last_undegraded":"2024-04-25 02:05:47.386703","last_fullsized":"2024-04-25 02:05:47.386703","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362340","last_change":"2024-04-25 02:05:47.028567","last_active":"2024-04-25 02:05:47.362340","last_peered":"2024-04-25 02:05:47.362340","last_clean":"2024-04-25 02:05:47.362340","last_became_active":"2024-04-25 02:05:47.027520","last_became_peered":"2024-04-25 02:05:47.027520","last_unstale":"2024-04-25 02:05:47.362340","last_undegraded":"2024-04-25 02:05:47.362340","last_fullsized":"2024-04-25 02:05:47.362340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387289","last_change":"2024-04-25 02:05:47.376362","last_active":"2024-04-25 02:05:47.387289","last_peered":"2024-04-25 02:05:47.387289","last_clean":"2024-04-25 02:05:47.387289","last_became_active":"2024-04-25 02:05:47.376045","last_became_peered":"2024-04-25 02:05:47.376045","last_unstale":"2024-04-25 02:05:47.387289","last_undegraded":"2024-04-25 02:05:47.387289","last_fullsized":"2024-04-25 02:05:47.387289","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351558","last_change":"2024-04-25 02:05:47.018376","last_active":"2024-04-25 02:05:47.351558","last_peered":"2024-04-25 02:05:47.351558","last_clean":"2024-04-25 02:05:47.351558","last_became_active":"2024-04-25 02:05:47.018044","last_became_peered":"2024-04-25 02:05:47.018044","last_unstale":"2024-04-25 02:05:47.351558","last_undegraded":"2024-04-25 02:05:47.351558","last_fullsized":"2024-04-25 02:05:47.351558","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389103","last_change":"2024-04-25 02:05:47.384783","last_active":"2024-04-25 02:05:47.389103","last_peered":"2024-04-25 02:05:47.389103","last_clean":"2024-04-25 02:05:47.389103","last_became_active":"2024-04-25 02:05:47.384440","last_became_peered":"2024-04-25 02:05:47.384440","last_unstale":"2024-04-25 02:05:47.389103","last_undegraded":"2024-04-25 02:05:47.389103","last_fullsized":"2024-04-25 02:05:47.389103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352883","last_change":"2024-04-25 02:05:47.000733","last_active":"2024-04-25 02:05:47.352883","last_peered":"2024-04-25 02:05:47.352883","last_clean":"2024-04-25 02:05:47.352883","last_became_active":"2024-04-25 02:05:47.000381","last_became_peered":"2024-04-25 02:05:47.000381","last_unstale":"2024-04-25 02:05:47.352883","last_undegraded":"2024-04-25 02:05:47.352883","last_fullsized":"2024-04-25 02:05:47.352883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372954","last_change":"2024-04-25 02:05:47.363717","last_active":"2024-04-25 02:05:47.372954","last_peered":"2024-04-25 02:05:47.372954","last_clean":"2024-04-25 02:05:47.372954","last_became_active":"2024-04-25 02:05:47.363378","last_became_peered":"2024-04-25 02:05:47.363378","last_unstale":"2024-04-25 02:05:47.372954","last_undegraded":"2024-04-25 02:05:47.372954","last_fullsized":"2024-04-25 02:05:47.372954","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377804","last_change":"2024-04-25 02:05:46.996992","last_active":"2024-04-25 02:05:47.377804","last_peered":"2024-04-25 02:05:47.377804","last_clean":"2024-04-25 02:05:47.377804","last_became_active":"2024-04-25 02:05:46.996648","last_became_peered":"2024-04-25 02:05:46.996648","last_unstale":"2024-04-25 02:05:47.377804","last_undegraded":"2024-04-25 02:05:47.377804","last_fullsized":"2024-04-25 02:05:47.377804","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389212","last_change":"2024-04-25 02:05:47.380340","last_active":"2024-04-25 02:05:47.389212","last_peered":"2024-04-25 02:05:47.389212","last_clean":"2024-04-25 02:05:47.389212","last_became_active":"2024-04-25 02:05:47.380051","last_became_peered":"2024-04-25 02:05:47.380051","last_unstale":"2024-04-25 02:05:47.389212","last_undegraded":"2024-04-25 02:05:47.389212","last_fullsized":"2024-04-25 02:05:47.389212","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351619","last_change":"2024-04-25 02:05:46.999913","last_active":"2024-04-25 02:05:47.351619","last_peered":"2024-04-25 02:05:47.351619","last_clean":"2024-04-25 02:05:47.351619","last_became_active":"2024-04-25 02:05:46.999553","last_became_peered":"2024-04-25 02:05:46.999553","last_unstale":"2024-04-25 02:05:47.351619","last_undegraded":"2024-04-25 02:05:47.351619","last_fullsized":"2024-04-25 02:05:47.351619","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384258","last_change":"2024-04-25 02:05:47.377775","last_active":"2024-04-25 02:05:47.384258","last_peered":"2024-04-25 02:05:47.384258","last_clean":"2024-04-25 02:05:47.384258","last_became_active":"2024-04-25 02:05:47.377456","last_became_peered":"2024-04-25 02:05:47.377456","last_unstale":"2024-04-25 02:05:47.384258","last_undegraded":"2024-04-25 02:05:47.384258","last_fullsized":"2024-04-25 02:05:47.384258","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389886","last_change":"2024-04-25 02:05:47.022408","last_active":"2024-04-25 02:05:47.389886","last_peered":"2024-04-25 02:05:47.389886","last_clean":"2024-04-25 02:05:47.389886","last_became_active":"2024-04-25 02:05:47.022145","last_became_peered":"2024-04-25 02:05:47.022145","last_unstale":"2024-04-25 02:05:47.389886","last_undegraded":"2024-04-25 02:05:47.389886","last_fullsized":"2024-04-25 02:05:47.389886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389273","last_change":"2024-04-25 02:05:47.383157","last_active":"2024-04-25 02:05:47.389273","last_peered":"2024-04-25 02:05:47.389273","last_clean":"2024-04-25 02:05:47.389273","last_became_active":"2024-04-25 02:05:47.382824","last_became_peered":"2024-04-25 02:05:47.382824","last_unstale":"2024-04-25 02:05:47.389273","last_undegraded":"2024-04-25 02:05:47.389273","last_fullsized":"2024-04-25 02:05:47.389273","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353638","last_change":"2024-04-25 02:05:46.999652","last_active":"2024-04-25 02:05:47.353638","last_peered":"2024-04-25 02:05:47.353638","last_clean":"2024-04-25 02:05:47.353638","last_became_active":"2024-04-25 02:05:46.999330","last_became_peered":"2024-04-25 02:05:46.999330","last_unstale":"2024-04-25 02:05:47.353638","last_undegraded":"2024-04-25 02:05:47.353638","last_fullsized":"2024-04-25 02:05:47.353638","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382043","last_change":"2024-04-25 02:05:47.377666","last_active":"2024-04-25 02:05:47.382043","last_peered":"2024-04-25 02:05:47.382043","last_clean":"2024-04-25 02:05:47.382043","last_became_active":"2024-04-25 02:05:47.376996","last_became_peered":"2024-04-25 02:05:47.376996","last_unstale":"2024-04-25 02:05:47.382043","last_undegraded":"2024-04-25 02:05:47.382043","last_fullsized":"2024-04-25 02:05:47.382043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361467","last_change":"2024-04-25 02:05:47.026476","last_active":"2024-04-25 02:05:47.361467","last_peered":"2024-04-25 02:05:47.361467","last_clean":"2024-04-25 02:05:47.361467","last_became_active":"2024-04-25 02:05:47.025938","last_became_peered":"2024-04-25 02:05:47.025938","last_unstale":"2024-04-25 02:05:47.361467","last_undegraded":"2024-04-25 02:05:47.361467","last_fullsized":"2024-04-25 02:05:47.361467","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373149","last_change":"2024-04-25 02:05:47.368468","last_active":"2024-04-25 02:05:47.373149","last_peered":"2024-04-25 02:05:47.373149","last_clean":"2024-04-25 02:05:47.373149","last_became_active":"2024-04-25 02:05:47.368132","last_became_peered":"2024-04-25 02:05:47.368132","last_unstale":"2024-04-25 02:05:47.373149","last_undegraded":"2024-04-25 02:05:47.373149","last_fullsized":"2024-04-25 02:05:47.373149","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388094","last_change":"2024-04-25 02:05:47.009725","last_active":"2024-04-25 02:05:47.388094","last_peered":"2024-04-25 02:05:47.388094","last_clean":"2024-04-25 02:05:47.388094","last_became_active":"2024-04-25 02:05:47.007964","last_became_peered":"2024-04-25 02:05:47.007964","last_unstale":"2024-04-25 02:05:47.388094","last_undegraded":"2024-04-25 02:05:47.388094","last_fullsized":"2024-04-25 02:05:47.388094","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388711","last_change":"2024-04-25 02:05:47.379616","last_active":"2024-04-25 02:05:47.388711","last_peered":"2024-04-25 02:05:47.388711","last_clean":"2024-04-25 02:05:47.388711","last_became_active":"2024-04-25 02:05:47.379103","last_became_peered":"2024-04-25 02:05:47.379103","last_unstale":"2024-04-25 02:05:47.388711","last_undegraded":"2024-04-25 02:05:47.388711","last_fullsized":"2024-04-25 02:05:47.388711","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360333","last_change":"2024-04-25 02:05:47.009452","last_active":"2024-04-25 02:05:47.360333","last_peered":"2024-04-25 02:05:47.360333","last_clean":"2024-04-25 02:05:47.360333","last_became_active":"2024-04-25 02:05:47.009116","last_became_peered":"2024-04-25 02:05:47.009116","last_unstale":"2024-04-25 02:05:47.360333","last_undegraded":"2024-04-25 02:05:47.360333","last_fullsized":"2024-04-25 02:05:47.360333","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389963","last_change":"2024-04-25 02:05:47.386054","last_active":"2024-04-25 02:05:47.389963","last_peered":"2024-04-25 02:05:47.389963","last_clean":"2024-04-25 02:05:47.389963","last_became_active":"2024-04-25 02:05:47.383311","last_became_peered":"2024-04-25 02:05:47.383311","last_unstale":"2024-04-25 02:05:47.389963","last_undegraded":"2024-04-25 02:05:47.389963","last_fullsized":"2024-04-25 02:05:47.389963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351815","last_change":"2024-04-25 02:05:47.020004","last_active":"2024-04-25 02:05:47.351815","last_peered":"2024-04-25 02:05:47.351815","last_clean":"2024-04-25 02:05:47.351815","last_became_active":"2024-04-25 02:05:47.019687","last_became_peered":"2024-04-25 02:05:47.019687","last_unstale":"2024-04-25 02:05:47.351815","last_undegraded":"2024-04-25 02:05:47.351815","last_fullsized":"2024-04-25 02:05:47.351815","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377719","last_change":"2024-04-25 02:05:47.365437","last_active":"2024-04-25 02:05:47.377719","last_peered":"2024-04-25 02:05:47.377719","last_clean":"2024-04-25 02:05:47.377719","last_became_active":"2024-04-25 02:05:47.365101","last_became_peered":"2024-04-25 02:05:47.365101","last_unstale":"2024-04-25 02:05:47.377719","last_undegraded":"2024-04-25 02:05:47.377719","last_fullsized":"2024-04-25 02:05:47.377719","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374047","last_change":"2024-04-25 02:05:46.993531","last_active":"2024-04-25 02:05:47.374047","last_peered":"2024-04-25 02:05:47.374047","last_clean":"2024-04-25 02:05:47.374047","last_became_active":"2024-04-25 02:05:46.993117","last_became_peered":"2024-04-25 02:05:46.993117","last_unstale":"2024-04-25 02:05:47.374047","last_undegraded":"2024-04-25 02:05:47.374047","last_fullsized":"2024-04-25 02:05:47.374047","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390894","last_change":"2024-04-25 02:05:47.385729","last_active":"2024-04-25 02:05:47.390894","last_peered":"2024-04-25 02:05:47.390894","last_clean":"2024-04-25 02:05:47.390894","last_became_active":"2024-04-25 02:05:47.385421","last_became_peered":"2024-04-25 02:05:47.385421","last_unstale":"2024-04-25 02:05:47.390894","last_undegraded":"2024-04-25 02:05:47.390894","last_fullsized":"2024-04-25 02:05:47.390894","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391988","last_change":"2024-04-25 02:05:47.020323","last_active":"2024-04-25 02:05:47.391988","last_peered":"2024-04-25 02:05:47.391988","last_clean":"2024-04-25 02:05:47.391988","last_became_active":"2024-04-25 02:05:47.019973","last_became_peered":"2024-04-25 02:05:47.019973","last_unstale":"2024-04-25 02:05:47.391988","last_undegraded":"2024-04-25 02:05:47.391988","last_fullsized":"2024-04-25 02:05:47.391988","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384226","last_change":"2024-04-25 02:05:47.375256","last_active":"2024-04-25 02:05:47.384226","last_peered":"2024-04-25 02:05:47.384226","last_clean":"2024-04-25 02:05:47.384226","last_became_active":"2024-04-25 02:05:47.374920","last_became_peered":"2024-04-25 02:05:47.374920","last_unstale":"2024-04-25 02:05:47.384226","last_undegraded":"2024-04-25 02:05:47.384226","last_fullsized":"2024-04-25 02:05:47.384226","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353210","last_change":"2024-04-25 02:05:46.995620","last_active":"2024-04-25 02:05:47.353210","last_peered":"2024-04-25 02:05:47.353210","last_clean":"2024-04-25 02:05:47.353210","last_became_active":"2024-04-25 02:05:46.995117","last_became_peered":"2024-04-25 02:05:46.995117","last_unstale":"2024-04-25 02:05:47.353210","last_undegraded":"2024-04-25 02:05:47.353210","last_fullsized":"2024-04-25 02:05:47.353210","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374027","last_change":"2024-04-25 02:05:47.372331","last_active":"2024-04-25 02:05:47.374027","last_peered":"2024-04-25 02:05:47.374027","last_clean":"2024-04-25 02:05:47.374027","last_became_active":"2024-04-25 02:05:47.372004","last_became_peered":"2024-04-25 02:05:47.372004","last_unstale":"2024-04-25 02:05:47.374027","last_undegraded":"2024-04-25 02:05:47.374027","last_fullsized":"2024-04-25 02:05:47.374027","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353418","last_change":"2024-04-25 02:05:46.999650","last_active":"2024-04-25 02:05:47.353418","last_peered":"2024-04-25 02:05:47.353418","last_clean":"2024-04-25 02:05:47.353418","last_became_active":"2024-04-25 02:05:46.999284","last_became_peered":"2024-04-25 02:05:46.999284","last_unstale":"2024-04-25 02:05:47.353418","last_undegraded":"2024-04-25 02:05:47.353418","last_fullsized":"2024-04-25 02:05:47.353418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386278","last_change":"2024-04-25 02:05:47.380781","last_active":"2024-04-25 02:05:47.386278","last_peered":"2024-04-25 02:05:47.386278","last_clean":"2024-04-25 02:05:47.386278","last_became_active":"2024-04-25 02:05:47.380462","last_became_peered":"2024-04-25 02:05:47.380462","last_unstale":"2024-04-25 02:05:47.386278","last_undegraded":"2024-04-25 02:05:47.386278","last_fullsized":"2024-04-25 02:05:47.386278","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362868","last_change":"2024-04-25 02:05:47.001836","last_active":"2024-04-25 02:05:47.362868","last_peered":"2024-04-25 02:05:47.362868","last_clean":"2024-04-25 02:05:47.362868","last_became_active":"2024-04-25 02:05:47.001509","last_became_peered":"2024-04-25 02:05:47.001509","last_unstale":"2024-04-25 02:05:47.362868","last_undegraded":"2024-04-25 02:05:47.362868","last_fullsized":"2024-04-25 02:05:47.362868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383697","last_change":"2024-04-25 02:05:47.373785","last_active":"2024-04-25 02:05:47.383697","last_peered":"2024-04-25 02:05:47.383697","last_clean":"2024-04-25 02:05:47.383697","last_became_active":"2024-04-25 02:05:47.371646","last_became_peered":"2024-04-25 02:05:47.371646","last_unstale":"2024-04-25 02:05:47.383697","last_undegraded":"2024-04-25 02:05:47.383697","last_fullsized":"2024-04-25 02:05:47.383697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359221","last_change":"2024-04-25 02:05:47.009028","last_active":"2024-04-25 02:05:47.359221","last_peered":"2024-04-25 02:05:47.359221","last_clean":"2024-04-25 02:05:47.359221","last_became_active":"2024-04-25 02:05:47.007728","last_became_peered":"2024-04-25 02:05:47.007728","last_unstale":"2024-04-25 02:05:47.359221","last_undegraded":"2024-04-25 02:05:47.359221","last_fullsized":"2024-04-25 02:05:47.359221","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390062","last_change":"2024-04-25 02:05:47.386599","last_active":"2024-04-25 02:05:47.390062","last_peered":"2024-04-25 02:05:47.390062","last_clean":"2024-04-25 02:05:47.390062","last_became_active":"2024-04-25 02:05:47.383052","last_became_peered":"2024-04-25 02:05:47.383052","last_unstale":"2024-04-25 02:05:47.390062","last_undegraded":"2024-04-25 02:05:47.390062","last_fullsized":"2024-04-25 02:05:47.390062","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351457","last_change":"2024-04-25 02:05:46.992970","last_active":"2024-04-25 02:05:47.351457","last_peered":"2024-04-25 02:05:47.351457","last_clean":"2024-04-25 02:05:47.351457","last_became_active":"2024-04-25 02:05:46.992580","last_became_peered":"2024-04-25 02:05:46.992580","last_unstale":"2024-04-25 02:05:47.351457","last_undegraded":"2024-04-25 02:05:47.351457","last_fullsized":"2024-04-25 02:05:47.351457","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390594","last_change":"2024-04-25 02:05:47.384947","last_active":"2024-04-25 02:05:47.390594","last_peered":"2024-04-25 02:05:47.390594","last_clean":"2024-04-25 02:05:47.390594","last_became_active":"2024-04-25 02:05:47.384477","last_became_peered":"2024-04-25 02:05:47.384477","last_unstale":"2024-04-25 02:05:47.390594","last_undegraded":"2024-04-25 02:05:47.390594","last_fullsized":"2024-04-25 02:05:47.390594","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390564","last_change":"2024-04-25 02:05:47.016029","last_active":"2024-04-25 02:05:47.390564","last_peered":"2024-04-25 02:05:47.390564","last_clean":"2024-04-25 02:05:47.390564","last_became_active":"2024-04-25 02:05:47.015470","last_became_peered":"2024-04-25 02:05:47.015470","last_unstale":"2024-04-25 02:05:47.390564","last_undegraded":"2024-04-25 02:05:47.390564","last_fullsized":"2024-04-25 02:05:47.390564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377970","last_change":"2024-04-25 02:05:47.368583","last_active":"2024-04-25 02:05:47.377970","last_peered":"2024-04-25 02:05:47.377970","last_clean":"2024-04-25 02:05:47.377970","last_became_active":"2024-04-25 02:05:47.366798","last_became_peered":"2024-04-25 02:05:47.366798","last_unstale":"2024-04-25 02:05:47.377970","last_undegraded":"2024-04-25 02:05:47.377970","last_fullsized":"2024-04-25 02:05:47.377970","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388229","last_change":"2024-04-25 02:05:47.005838","last_active":"2024-04-25 02:05:47.388229","last_peered":"2024-04-25 02:05:47.388229","last_clean":"2024-04-25 02:05:47.388229","last_became_active":"2024-04-25 02:05:47.005500","last_became_peered":"2024-04-25 02:05:47.005500","last_unstale":"2024-04-25 02:05:47.388229","last_undegraded":"2024-04-25 02:05:47.388229","last_fullsized":"2024-04-25 02:05:47.388229","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386313","last_change":"2024-04-25 02:05:47.380789","last_active":"2024-04-25 02:05:47.386313","last_peered":"2024-04-25 02:05:47.386313","last_clean":"2024-04-25 02:05:47.386313","last_became_active":"2024-04-25 02:05:47.380537","last_became_peered":"2024-04-25 02:05:47.380537","last_unstale":"2024-04-25 02:05:47.386313","last_undegraded":"2024-04-25 02:05:47.386313","last_fullsized":"2024-04-25 02:05:47.386313","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388104","last_change":"2024-04-25 02:05:47.006598","last_active":"2024-04-25 02:05:47.388104","last_peered":"2024-04-25 02:05:47.388104","last_clean":"2024-04-25 02:05:47.388104","last_became_active":"2024-04-25 02:05:47.006139","last_became_peered":"2024-04-25 02:05:47.006139","last_unstale":"2024-04-25 02:05:47.388104","last_undegraded":"2024-04-25 02:05:47.388104","last_fullsized":"2024-04-25 02:05:47.388104","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378165","last_change":"2024-04-25 02:05:47.374238","last_active":"2024-04-25 02:05:47.378165","last_peered":"2024-04-25 02:05:47.378165","last_clean":"2024-04-25 02:05:47.378165","last_became_active":"2024-04-25 02:05:47.373927","last_became_peered":"2024-04-25 02:05:47.373927","last_unstale":"2024-04-25 02:05:47.378165","last_undegraded":"2024-04-25 02:05:47.378165","last_fullsized":"2024-04-25 02:05:47.378165","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353045","last_change":"2024-04-25 02:05:47.003496","last_active":"2024-04-25 02:05:47.353045","last_peered":"2024-04-25 02:05:47.353045","last_clean":"2024-04-25 02:05:47.353045","last_became_active":"2024-04-25 02:05:47.002906","last_became_peered":"2024-04-25 02:05:47.002906","last_unstale":"2024-04-25 02:05:47.353045","last_undegraded":"2024-04-25 02:05:47.353045","last_fullsized":"2024-04-25 02:05:47.353045","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390790","last_change":"2024-04-25 02:05:47.385923","last_active":"2024-04-25 02:05:47.390790","last_peered":"2024-04-25 02:05:47.390790","last_clean":"2024-04-25 02:05:47.390790","last_became_active":"2024-04-25 02:05:47.385607","last_became_peered":"2024-04-25 02:05:47.385607","last_unstale":"2024-04-25 02:05:47.390790","last_undegraded":"2024-04-25 02:05:47.390790","last_fullsized":"2024-04-25 02:05:47.390790","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362831","last_change":"2024-04-25 02:05:46.999151","last_active":"2024-04-25 02:05:47.362831","last_peered":"2024-04-25 02:05:47.362831","last_clean":"2024-04-25 02:05:47.362831","last_became_active":"2024-04-25 02:05:46.998843","last_became_peered":"2024-04-25 02:05:46.998843","last_unstale":"2024-04-25 02:05:47.362831","last_undegraded":"2024-04-25 02:05:47.362831","last_fullsized":"2024-04-25 02:05:47.362831","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387468","last_change":"2024-04-25 02:05:47.381229","last_active":"2024-04-25 02:05:47.387468","last_peered":"2024-04-25 02:05:47.387468","last_clean":"2024-04-25 02:05:47.387468","last_became_active":"2024-04-25 02:05:47.380920","last_became_peered":"2024-04-25 02:05:47.380920","last_unstale":"2024-04-25 02:05:47.387468","last_undegraded":"2024-04-25 02:05:47.387468","last_fullsized":"2024-04-25 02:05:47.387468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385052","last_change":"2024-04-25 02:05:47.002796","last_active":"2024-04-25 02:05:47.385052","last_peered":"2024-04-25 02:05:47.385052","last_clean":"2024-04-25 02:05:47.385052","last_became_active":"2024-04-25 02:05:47.002460","last_became_peered":"2024-04-25 02:05:47.002460","last_unstale":"2024-04-25 02:05:47.385052","last_undegraded":"2024-04-25 02:05:47.385052","last_fullsized":"2024-04-25 02:05:47.385052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]}]}]}} 2024-04-25T02:05:54.623 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:05:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63bcc54700 1 Processor -- start 2024-04-25T02:05:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63bcc54700 1 -- start start 2024-04-25T02:05:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63bcc54700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80f5990 0x7f63b810b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63bcc54700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b810b6c0 0x7f63b819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63bcc54700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b81a09f0 con 0x7f63b810bb10 2024-04-25T02:05:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63bcc54700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80fa510 con 0x7f63b810b6c0 2024-04-25T02:05:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63bcc54700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63b81a0c10 con 0x7f63b80f5990 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63b504f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b810b6c0 0x7f63b819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63b5850700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80f5990 0x7f63b810b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63b6051700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f63b810bb10 0x7f63b81a01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57558/0 (socket says 172.21.15.57:57558) 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.764 7f63b6051700 1 -- 172.21.15.57:0/2656622294 learned_addr learned my addr 172.21.15.57:0/2656622294 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b484e700 1 -- 172.21.15.57:0/2656622294 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490505914 0 0) 0x7f63b0001490 con 0x7f63b810bb10 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b5850700 1 -- 172.21.15.57:0/2656622294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b810b6c0 msgr2=0x7f63b819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b5850700 1 --2- 172.21.15.57:0/2656622294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b810b6c0 0x7f63b819fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b5850700 1 -- 172.21.15.57:0/2656622294 >> v1:172.21.15.57:6789/0 conn(0x7f63b810bb10 legacy=0x7f63b81a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b5850700 1 -- 172.21.15.57:0/2656622294 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b81a9350 con 0x7f63b80f5990 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b504f700 1 --2- 172.21.15.57:0/2656622294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b810b6c0 0x7f63b819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b5850700 1 --2- 172.21.15.57:0/2656622294 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80f5990 0x7f63b810b090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f63b810f8a0 tx=0x7f63a800b9d0).ready entity=mon.2 client_cookie=7f2eb4ccaa06f4f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b484e700 1 -- 172.21.15.57:0/2656622294 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63b81a9350 con 0x7f63b80f5990 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b484e700 1 -- 172.21.15.57:0/2656622294 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a800d570 con 0x7f63b80f5990 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.765 7f63b484e700 1 -- 172.21.15.57:0/2656622294 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63a800d940 con 0x7f63b80f5990 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.766 7f63bcc54700 1 -- 172.21.15.57:0/2656622294 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80f5990 msgr2=0x7f63b810b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.766 7f63bcc54700 1 --2- 172.21.15.57:0/2656622294 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80f5990 0x7f63b810b090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f63b810f8a0 tx=0x7f63a800b9d0).stop 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.766 7f63bcc54700 1 -- 172.21.15.57:0/2656622294 shutdown_connections 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.766 7f63bcc54700 1 --2- 172.21.15.57:0/2656622294 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80f5990 0x7f63b810b090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.766 7f63bcc54700 1 --2- 172.21.15.57:0/2656622294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b810b6c0 0x7f63b819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.766 7f63bcc54700 1 -- 172.21.15.57:0/2656622294 >> 172.21.15.57:0/2656622294 conn(0x7f63b81139f0 msgr2=0x7f63b80f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.766 7f63bcc54700 1 -- 172.21.15.57:0/2656622294 shutdown_connections 2024-04-25T02:05:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.766 7f63bcc54700 1 -- 172.21.15.57:0/2656622294 wait complete. 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63bcc54700 1 Processor -- start 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63bcc54700 1 -- start start 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63bcc54700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63b80d8f40 0x7f63b80d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63bcc54700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b80d42c0 0x7f63b81afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63bcc54700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80d4710 0x7f63b81b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63bcc54700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80d9990 con 0x7f63b80d8f40 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63bcc54700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80d61b0 con 0x7f63b80d42c0 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63bcc54700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63b81b0b20 con 0x7f63b80d4710 2024-04-25T02:05:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63b5850700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63b80d8f40 0x7f63b80d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63b5850700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63b80d8f40 0x7f63b80d3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57260/0 (socket says 172.21.15.57:57260) 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63b5850700 1 -- 172.21.15.57:0/4074136493 learned_addr learned my addr 172.21.15.57:0/4074136493 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63b504f700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b80d42c0 0x7f63b81afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.790 7f63b6051700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80d4710 0x7f63b81b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63b5850700 1 -- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80d4710 msgr2=0x7f63b81b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63b5850700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80d4710 0x7f63b81b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63b5850700 1 -- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b80d42c0 msgr2=0x7f63b81afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63b5850700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b80d42c0 0x7f63b81afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63b5850700 1 -- 172.21.15.57:0/4074136493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b81b0d50 con 0x7f63b80d8f40 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63b504f700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b80d42c0 0x7f63b81afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63b6051700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80d4710 0x7f63b81b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63b5850700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63b80d8f40 0x7f63b80d3c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f63b810f8a0 tx=0x7f63a80068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63aeffd700 1 -- 172.21.15.57:0/4074136493 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63b81b0d50 con 0x7f63b80d8f40 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63aeffd700 1 -- 172.21.15.57:0/4074136493 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a8011860 con 0x7f63b80d8f40 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b81b7630 con 0x7f63b80d8f40 2024-04-25T02:05:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63aeffd700 1 -- 172.21.15.57:0/4074136493 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f63a8017040 con 0x7f63b80d8f40 2024-04-25T02:05:54.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.791 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b81b7a10 con 0x7f63b80d8f40 2024-04-25T02:05:54.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.792 7f63aeffd700 1 -- 172.21.15.57:0/4074136493 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f63a8011c30 con 0x7f63b80d8f40 2024-04-25T02:05:54.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.792 7f63aeffd700 1 -- 172.21.15.57:0/4074136493 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f63a8018070 con 0x7f63b80d8f40 2024-04-25T02:05:54.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.792 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b80f0860 con 0x7f63b80d8f40 2024-04-25T02:05:54.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.796 7f63aeffd700 1 -- 172.21.15.57:0/4074136493 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f63a8011650 con 0x7f63b80d8f40 2024-04-25T02:05:54.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.903 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f63b8087810 con 0x7f639c0145b0 2024-04-25T02:05:54.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.910 7f63aeffd700 1 -- 172.21.15.57:0/4074136493 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306153 (unknown 2965378022 0 240775306) 0x7f63a000dcf0 con 0x7f639c0145b0 2024-04-25T02:05:54.919 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 >> v1:172.21.15.57:6816/43033 conn(0x7f639c0145b0 legacy=0x7f639c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63b80d8f40 msgr2=0x7f63b80d3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63b80d8f40 0x7f63b80d3c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f63b810f8a0 tx=0x7f63a80068c0).stop 2024-04-25T02:05:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 shutdown_connections 2024-04-25T02:05:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f63b80d4710 0x7f63b81b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63b80d8f40 0x7f63b80d3c90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:54.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 --2- 172.21.15.57:0/4074136493 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63b80d42c0 0x7f63b81afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:54.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 >> 172.21.15.57:0/4074136493 conn(0x7f63b80c5250 msgr2=0x7f63b80c22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:54.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 shutdown_connections 2024-04-25T02:05:54.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:54.913 7f63bcc54700 1 -- 172.21.15.57:0/4074136493 wait complete. 2024-04-25T02:05:54.923 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:05:54.929 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25 02:05:54.667037","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000909"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372976","last_change":"2024-04-25 02:05:47.369320","last_active":"2024-04-25 02:05:47.372976","last_peered":"2024-04-25 02:05:47.372976","last_clean":"2024-04-25 02:05:47.372976","last_became_active":"2024-04-25 02:05:47.369008","last_became_peered":"2024-04-25 02:05:47.369008","last_unstale":"2024-04-25 02:05:47.372976","last_undegraded":"2024-04-25 02:05:47.372976","last_fullsized":"2024-04-25 02:05:47.372976","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358525","last_change":"2024-04-25 02:05:47.021686","last_active":"2024-04-25 02:05:47.358525","last_peered":"2024-04-25 02:05:47.358525","last_clean":"2024-04-25 02:05:47.358525","last_became_active":"2024-04-25 02:05:47.020938","last_became_peered":"2024-04-25 02:05:47.020938","last_unstale":"2024-04-25 02:05:47.358525","last_undegraded":"2024-04-25 02:05:47.358525","last_fullsized":"2024-04-25 02:05:47.358525","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388999","last_change":"2024-04-25 02:05:47.384312","last_active":"2024-04-25 02:05:47.388999","last_peered":"2024-04-25 02:05:47.388999","last_clean":"2024-04-25 02:05:47.388999","last_became_active":"2024-04-25 02:05:47.378585","last_became_peered":"2024-04-25 02:05:47.378585","last_unstale":"2024-04-25 02:05:47.388999","last_undegraded":"2024-04-25 02:05:47.388999","last_fullsized":"2024-04-25 02:05:47.388999","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363658","last_change":"2024-04-25 02:05:47.020533","last_active":"2024-04-25 02:05:47.363658","last_peered":"2024-04-25 02:05:47.363658","last_clean":"2024-04-25 02:05:47.363658","last_became_active":"2024-04-25 02:05:47.019990","last_became_peered":"2024-04-25 02:05:47.019990","last_unstale":"2024-04-25 02:05:47.363658","last_undegraded":"2024-04-25 02:05:47.363658","last_fullsized":"2024-04-25 02:05:47.363658","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388734","last_change":"2024-04-25 02:05:47.379801","last_active":"2024-04-25 02:05:47.388734","last_peered":"2024-04-25 02:05:47.388734","last_clean":"2024-04-25 02:05:47.388734","last_became_active":"2024-04-25 02:05:47.379321","last_became_peered":"2024-04-25 02:05:47.379321","last_unstale":"2024-04-25 02:05:47.388734","last_undegraded":"2024-04-25 02:05:47.388734","last_fullsized":"2024-04-25 02:05:47.388734","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357766","last_change":"2024-04-25 02:05:47.020828","last_active":"2024-04-25 02:05:47.357766","last_peered":"2024-04-25 02:05:47.357766","last_clean":"2024-04-25 02:05:47.357766","last_became_active":"2024-04-25 02:05:47.020320","last_became_peered":"2024-04-25 02:05:47.020320","last_unstale":"2024-04-25 02:05:47.357766","last_undegraded":"2024-04-25 02:05:47.357766","last_fullsized":"2024-04-25 02:05:47.357766","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373126","last_change":"2024-04-25 02:05:47.365068","last_active":"2024-04-25 02:05:47.373126","last_peered":"2024-04-25 02:05:47.373126","last_clean":"2024-04-25 02:05:47.373126","last_became_active":"2024-04-25 02:05:47.364768","last_became_peered":"2024-04-25 02:05:47.364768","last_unstale":"2024-04-25 02:05:47.373126","last_undegraded":"2024-04-25 02:05:47.373126","last_fullsized":"2024-04-25 02:05:47.373126","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.355780","last_change":"2024-04-25 02:05:47.028823","last_active":"2024-04-25 02:05:47.355780","last_peered":"2024-04-25 02:05:47.355780","last_clean":"2024-04-25 02:05:47.355780","last_became_active":"2024-04-25 02:05:47.027770","last_became_peered":"2024-04-25 02:05:47.027770","last_unstale":"2024-04-25 02:05:47.355780","last_undegraded":"2024-04-25 02:05:47.355780","last_fullsized":"2024-04-25 02:05:47.355780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382006","last_change":"2024-04-25 02:05:47.377307","last_active":"2024-04-25 02:05:47.382006","last_peered":"2024-04-25 02:05:47.382006","last_clean":"2024-04-25 02:05:47.382006","last_became_active":"2024-04-25 02:05:47.376546","last_became_peered":"2024-04-25 02:05:47.376546","last_unstale":"2024-04-25 02:05:47.382006","last_undegraded":"2024-04-25 02:05:47.382006","last_fullsized":"2024-04-25 02:05:47.382006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353187","last_change":"2024-04-25 02:05:46.996093","last_active":"2024-04-25 02:05:47.353187","last_peered":"2024-04-25 02:05:47.353187","last_clean":"2024-04-25 02:05:47.353187","last_became_active":"2024-04-25 02:05:46.995769","last_became_peered":"2024-04-25 02:05:46.995769","last_unstale":"2024-04-25 02:05:47.353187","last_undegraded":"2024-04-25 02:05:47.353187","last_fullsized":"2024-04-25 02:05:47.353187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390769","last_change":"2024-04-25 02:05:47.385883","last_active":"2024-04-25 02:05:47.390769","last_peered":"2024-04-25 02:05:47.390769","last_clean":"2024-04-25 02:05:47.390769","last_became_active":"2024-04-25 02:05:47.385568","last_became_peered":"2024-04-25 02:05:47.385568","last_unstale":"2024-04-25 02:05:47.390769","last_undegraded":"2024-04-25 02:05:47.390769","last_fullsized":"2024-04-25 02:05:47.390769","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362579","last_change":"2024-04-25 02:05:47.006764","last_active":"2024-04-25 02:05:47.362579","last_peered":"2024-04-25 02:05:47.362579","last_clean":"2024-04-25 02:05:47.362579","last_became_active":"2024-04-25 02:05:47.006519","last_became_peered":"2024-04-25 02:05:47.006519","last_unstale":"2024-04-25 02:05:47.362579","last_undegraded":"2024-04-25 02:05:47.362579","last_fullsized":"2024-04-25 02:05:47.362579","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391008","last_change":"2024-04-25 02:05:47.385392","last_active":"2024-04-25 02:05:47.391008","last_peered":"2024-04-25 02:05:47.391008","last_clean":"2024-04-25 02:05:47.391008","last_became_active":"2024-04-25 02:05:47.385092","last_became_peered":"2024-04-25 02:05:47.385092","last_unstale":"2024-04-25 02:05:47.391008","last_undegraded":"2024-04-25 02:05:47.391008","last_fullsized":"2024-04-25 02:05:47.391008","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387246","last_change":"2024-04-25 02:05:47.003242","last_active":"2024-04-25 02:05:47.387246","last_peered":"2024-04-25 02:05:47.387246","last_clean":"2024-04-25 02:05:47.387246","last_became_active":"2024-04-25 02:05:47.002466","last_became_peered":"2024-04-25 02:05:47.002466","last_unstale":"2024-04-25 02:05:47.387246","last_undegraded":"2024-04-25 02:05:47.387246","last_fullsized":"2024-04-25 02:05:47.387246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390926","last_change":"2024-04-25 02:05:47.387162","last_active":"2024-04-25 02:05:47.390926","last_peered":"2024-04-25 02:05:47.390926","last_clean":"2024-04-25 02:05:47.390926","last_became_active":"2024-04-25 02:05:47.386846","last_became_peered":"2024-04-25 02:05:47.386846","last_unstale":"2024-04-25 02:05:47.390926","last_undegraded":"2024-04-25 02:05:47.390926","last_fullsized":"2024-04-25 02:05:47.390926","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390398","last_change":"2024-04-25 02:05:47.012882","last_active":"2024-04-25 02:05:47.390398","last_peered":"2024-04-25 02:05:47.390398","last_clean":"2024-04-25 02:05:47.390398","last_became_active":"2024-04-25 02:05:47.012356","last_became_peered":"2024-04-25 02:05:47.012356","last_unstale":"2024-04-25 02:05:47.390398","last_undegraded":"2024-04-25 02:05:47.390398","last_fullsized":"2024-04-25 02:05:47.390398","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.381620","last_change":"2024-04-25 02:05:47.376840","last_active":"2024-04-25 02:05:47.381620","last_peered":"2024-04-25 02:05:47.381620","last_clean":"2024-04-25 02:05:47.381620","last_became_active":"2024-04-25 02:05:47.376550","last_became_peered":"2024-04-25 02:05:47.376550","last_unstale":"2024-04-25 02:05:47.381620","last_undegraded":"2024-04-25 02:05:47.381620","last_fullsized":"2024-04-25 02:05:47.381620","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390373","last_change":"2024-04-25 02:05:47.013902","last_active":"2024-04-25 02:05:47.390373","last_peered":"2024-04-25 02:05:47.390373","last_clean":"2024-04-25 02:05:47.390373","last_became_active":"2024-04-25 02:05:47.013571","last_became_peered":"2024-04-25 02:05:47.013571","last_unstale":"2024-04-25 02:05:47.390373","last_undegraded":"2024-04-25 02:05:47.390373","last_fullsized":"2024-04-25 02:05:47.390373","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391228","last_change":"2024-04-25 02:05:47.388939","last_active":"2024-04-25 02:05:47.391228","last_peered":"2024-04-25 02:05:47.391228","last_clean":"2024-04-25 02:05:47.391228","last_became_active":"2024-04-25 02:05:47.388673","last_became_peered":"2024-04-25 02:05:47.388673","last_unstale":"2024-04-25 02:05:47.391228","last_undegraded":"2024-04-25 02:05:47.391228","last_fullsized":"2024-04-25 02:05:47.391228","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363555","last_change":"2024-04-25 02:05:47.016797","last_active":"2024-04-25 02:05:47.363555","last_peered":"2024-04-25 02:05:47.363555","last_clean":"2024-04-25 02:05:47.363555","last_became_active":"2024-04-25 02:05:47.016484","last_became_peered":"2024-04-25 02:05:47.016484","last_unstale":"2024-04-25 02:05:47.363555","last_undegraded":"2024-04-25 02:05:47.363555","last_fullsized":"2024-04-25 02:05:47.363555","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373750","last_change":"2024-04-25 02:05:47.363022","last_active":"2024-04-25 02:05:47.373750","last_peered":"2024-04-25 02:05:47.373750","last_clean":"2024-04-25 02:05:47.373750","last_became_active":"2024-04-25 02:05:47.362681","last_became_peered":"2024-04-25 02:05:47.362681","last_unstale":"2024-04-25 02:05:47.373750","last_undegraded":"2024-04-25 02:05:47.373750","last_fullsized":"2024-04-25 02:05:47.373750","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360184","last_change":"2024-04-25 02:05:47.012986","last_active":"2024-04-25 02:05:47.360184","last_peered":"2024-04-25 02:05:47.360184","last_clean":"2024-04-25 02:05:47.360184","last_became_active":"2024-04-25 02:05:47.012673","last_became_peered":"2024-04-25 02:05:47.012673","last_unstale":"2024-04-25 02:05:47.360184","last_undegraded":"2024-04-25 02:05:47.360184","last_fullsized":"2024-04-25 02:05:47.360184","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388639","last_change":"2024-04-25 02:05:47.378766","last_active":"2024-04-25 02:05:47.388639","last_peered":"2024-04-25 02:05:47.388639","last_clean":"2024-04-25 02:05:47.388639","last_became_active":"2024-04-25 02:05:47.376368","last_became_peered":"2024-04-25 02:05:47.376368","last_unstale":"2024-04-25 02:05:47.388639","last_undegraded":"2024-04-25 02:05:47.388639","last_fullsized":"2024-04-25 02:05:47.388639","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386504","last_change":"2024-04-25 02:05:47.003903","last_active":"2024-04-25 02:05:47.386504","last_peered":"2024-04-25 02:05:47.386504","last_clean":"2024-04-25 02:05:47.386504","last_became_active":"2024-04-25 02:05:47.003584","last_became_peered":"2024-04-25 02:05:47.003584","last_unstale":"2024-04-25 02:05:47.386504","last_undegraded":"2024-04-25 02:05:47.386504","last_fullsized":"2024-04-25 02:05:47.386504","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391545","last_change":"2024-04-25 02:05:47.382468","last_active":"2024-04-25 02:05:47.391545","last_peered":"2024-04-25 02:05:47.391545","last_clean":"2024-04-25 02:05:47.391545","last_became_active":"2024-04-25 02:05:47.382161","last_became_peered":"2024-04-25 02:05:47.382161","last_unstale":"2024-04-25 02:05:47.391545","last_undegraded":"2024-04-25 02:05:47.391545","last_fullsized":"2024-04-25 02:05:47.391545","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380007","last_change":"2024-04-25 02:05:47.014185","last_active":"2024-04-25 02:05:47.380007","last_peered":"2024-04-25 02:05:47.380007","last_clean":"2024-04-25 02:05:47.380007","last_became_active":"2024-04-25 02:05:47.013874","last_became_peered":"2024-04-25 02:05:47.013874","last_unstale":"2024-04-25 02:05:47.380007","last_undegraded":"2024-04-25 02:05:47.380007","last_fullsized":"2024-04-25 02:05:47.380007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383613","last_change":"2024-04-25 02:05:47.375244","last_active":"2024-04-25 02:05:47.383613","last_peered":"2024-04-25 02:05:47.383613","last_clean":"2024-04-25 02:05:47.383613","last_became_active":"2024-04-25 02:05:47.374904","last_became_peered":"2024-04-25 02:05:47.374904","last_unstale":"2024-04-25 02:05:47.383613","last_undegraded":"2024-04-25 02:05:47.383613","last_fullsized":"2024-04-25 02:05:47.383613","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391628","last_change":"2024-04-25 02:05:47.013961","last_active":"2024-04-25 02:05:47.391628","last_peered":"2024-04-25 02:05:47.391628","last_clean":"2024-04-25 02:05:47.391628","last_became_active":"2024-04-25 02:05:47.013634","last_became_peered":"2024-04-25 02:05:47.013634","last_unstale":"2024-04-25 02:05:47.391628","last_undegraded":"2024-04-25 02:05:47.391628","last_fullsized":"2024-04-25 02:05:47.391628","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387497","last_change":"2024-04-25 02:05:47.380961","last_active":"2024-04-25 02:05:47.387497","last_peered":"2024-04-25 02:05:47.387497","last_clean":"2024-04-25 02:05:47.387497","last_became_active":"2024-04-25 02:05:47.380213","last_became_peered":"2024-04-25 02:05:47.380213","last_unstale":"2024-04-25 02:05:47.387497","last_undegraded":"2024-04-25 02:05:47.387497","last_fullsized":"2024-04-25 02:05:47.387497","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353098","last_change":"2024-04-25 02:05:47.002799","last_active":"2024-04-25 02:05:47.353098","last_peered":"2024-04-25 02:05:47.353098","last_clean":"2024-04-25 02:05:47.353098","last_became_active":"2024-04-25 02:05:47.002131","last_became_peered":"2024-04-25 02:05:47.002131","last_unstale":"2024-04-25 02:05:47.353098","last_undegraded":"2024-04-25 02:05:47.353098","last_fullsized":"2024-04-25 02:05:47.353098","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386374","last_change":"2024-04-25 02:05:47.372655","last_active":"2024-04-25 02:05:47.386374","last_peered":"2024-04-25 02:05:47.386374","last_clean":"2024-04-25 02:05:47.386374","last_became_active":"2024-04-25 02:05:47.372344","last_became_peered":"2024-04-25 02:05:47.372344","last_unstale":"2024-04-25 02:05:47.386374","last_undegraded":"2024-04-25 02:05:47.386374","last_fullsized":"2024-04-25 02:05:47.386374","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352064","last_change":"2024-04-25 02:05:46.999849","last_active":"2024-04-25 02:05:47.352064","last_peered":"2024-04-25 02:05:47.352064","last_clean":"2024-04-25 02:05:47.352064","last_became_active":"2024-04-25 02:05:46.999494","last_became_peered":"2024-04-25 02:05:46.999494","last_unstale":"2024-04-25 02:05:47.352064","last_undegraded":"2024-04-25 02:05:47.352064","last_fullsized":"2024-04-25 02:05:47.352064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388549","last_change":"2024-04-25 02:05:47.377522","last_active":"2024-04-25 02:05:47.388549","last_peered":"2024-04-25 02:05:47.388549","last_clean":"2024-04-25 02:05:47.388549","last_became_active":"2024-04-25 02:05:47.374641","last_became_peered":"2024-04-25 02:05:47.374641","last_unstale":"2024-04-25 02:05:47.388549","last_undegraded":"2024-04-25 02:05:47.388549","last_fullsized":"2024-04-25 02:05:47.388549","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389608","last_change":"2024-04-25 02:05:47.017557","last_active":"2024-04-25 02:05:47.389608","last_peered":"2024-04-25 02:05:47.389608","last_clean":"2024-04-25 02:05:47.389608","last_became_active":"2024-04-25 02:05:47.017189","last_became_peered":"2024-04-25 02:05:47.017189","last_unstale":"2024-04-25 02:05:47.389608","last_undegraded":"2024-04-25 02:05:47.389608","last_fullsized":"2024-04-25 02:05:47.389608","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389984","last_change":"2024-04-25 02:05:47.386122","last_active":"2024-04-25 02:05:47.389984","last_peered":"2024-04-25 02:05:47.389984","last_clean":"2024-04-25 02:05:47.389984","last_became_active":"2024-04-25 02:05:47.385756","last_became_peered":"2024-04-25 02:05:47.385756","last_unstale":"2024-04-25 02:05:47.389984","last_undegraded":"2024-04-25 02:05:47.389984","last_fullsized":"2024-04-25 02:05:47.389984","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352989","last_change":"2024-04-25 02:05:47.019790","last_active":"2024-04-25 02:05:47.352989","last_peered":"2024-04-25 02:05:47.352989","last_clean":"2024-04-25 02:05:47.352989","last_became_active":"2024-04-25 02:05:47.019471","last_became_peered":"2024-04-25 02:05:47.019471","last_unstale":"2024-04-25 02:05:47.352989","last_undegraded":"2024-04-25 02:05:47.352989","last_fullsized":"2024-04-25 02:05:47.352989","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389192","last_change":"2024-04-25 02:05:47.380774","last_active":"2024-04-25 02:05:47.389192","last_peered":"2024-04-25 02:05:47.389192","last_clean":"2024-04-25 02:05:47.389192","last_became_active":"2024-04-25 02:05:47.380517","last_became_peered":"2024-04-25 02:05:47.380517","last_unstale":"2024-04-25 02:05:47.389192","last_undegraded":"2024-04-25 02:05:47.389192","last_fullsized":"2024-04-25 02:05:47.389192","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352014","last_change":"2024-04-25 02:05:47.005189","last_active":"2024-04-25 02:05:47.352014","last_peered":"2024-04-25 02:05:47.352014","last_clean":"2024-04-25 02:05:47.352014","last_became_active":"2024-04-25 02:05:47.004657","last_became_peered":"2024-04-25 02:05:47.004657","last_unstale":"2024-04-25 02:05:47.352014","last_undegraded":"2024-04-25 02:05:47.352014","last_fullsized":"2024-04-25 02:05:47.352014","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388617","last_change":"2024-04-25 02:05:47.377256","last_active":"2024-04-25 02:05:47.388617","last_peered":"2024-04-25 02:05:47.388617","last_clean":"2024-04-25 02:05:47.388617","last_became_active":"2024-04-25 02:05:47.376589","last_became_peered":"2024-04-25 02:05:47.376589","last_unstale":"2024-04-25 02:05:47.388617","last_undegraded":"2024-04-25 02:05:47.388617","last_fullsized":"2024-04-25 02:05:47.388617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359016","last_change":"2024-04-25 02:05:46.994018","last_active":"2024-04-25 02:05:47.359016","last_peered":"2024-04-25 02:05:47.359016","last_clean":"2024-04-25 02:05:47.359016","last_became_active":"2024-04-25 02:05:46.993698","last_became_peered":"2024-04-25 02:05:46.993698","last_unstale":"2024-04-25 02:05:47.359016","last_undegraded":"2024-04-25 02:05:47.359016","last_fullsized":"2024-04-25 02:05:47.359016","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389233","last_change":"2024-04-25 02:05:47.382653","last_active":"2024-04-25 02:05:47.389233","last_peered":"2024-04-25 02:05:47.389233","last_clean":"2024-04-25 02:05:47.389233","last_became_active":"2024-04-25 02:05:47.382376","last_became_peered":"2024-04-25 02:05:47.382376","last_unstale":"2024-04-25 02:05:47.389233","last_undegraded":"2024-04-25 02:05:47.389233","last_fullsized":"2024-04-25 02:05:47.389233","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352520","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:05:47.352520","last_peered":"2024-04-25 02:05:47.352520","last_clean":"2024-04-25 02:05:47.352520","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:05:47.352520","last_undegraded":"2024-04-25 02:05:47.352520","last_fullsized":"2024-04-25 02:05:47.352520","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353532","last_change":"2024-04-25 02:05:47.001851","last_active":"2024-04-25 02:05:47.353532","last_peered":"2024-04-25 02:05:47.353532","last_clean":"2024-04-25 02:05:47.353532","last_became_active":"2024-04-25 02:05:47.001503","last_became_peered":"2024-04-25 02:05:47.001503","last_unstale":"2024-04-25 02:05:47.353532","last_undegraded":"2024-04-25 02:05:47.353532","last_fullsized":"2024-04-25 02:05:47.353532","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384277","last_change":"2024-04-25 02:05:47.378248","last_active":"2024-04-25 02:05:47.384277","last_peered":"2024-04-25 02:05:47.384277","last_clean":"2024-04-25 02:05:47.384277","last_became_active":"2024-04-25 02:05:47.377943","last_became_peered":"2024-04-25 02:05:47.377943","last_unstale":"2024-04-25 02:05:47.384277","last_undegraded":"2024-04-25 02:05:47.384277","last_fullsized":"2024-04-25 02:05:47.384277","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360052","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:05:47.360052","last_peered":"2024-04-25 02:05:47.360052","last_clean":"2024-04-25 02:05:47.360052","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:05:47.360052","last_undegraded":"2024-04-25 02:05:47.360052","last_fullsized":"2024-04-25 02:05:47.360052","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388406","last_change":"2024-04-25 02:05:47.021725","last_active":"2024-04-25 02:05:47.388406","last_peered":"2024-04-25 02:05:47.388406","last_clean":"2024-04-25 02:05:47.388406","last_became_active":"2024-04-25 02:05:47.021378","last_became_peered":"2024-04-25 02:05:47.021378","last_unstale":"2024-04-25 02:05:47.388406","last_undegraded":"2024-04-25 02:05:47.388406","last_fullsized":"2024-04-25 02:05:47.388406","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352584","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:05:47.352584","last_peered":"2024-04-25 02:05:47.352584","last_clean":"2024-04-25 02:05:47.352584","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:05:47.352584","last_undegraded":"2024-04-25 02:05:47.352584","last_fullsized":"2024-04-25 02:05:47.352584","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356151","last_change":"2024-04-25 02:05:47.028109","last_active":"2024-04-25 02:05:47.356151","last_peered":"2024-04-25 02:05:47.356151","last_clean":"2024-04-25 02:05:47.356151","last_became_active":"2024-04-25 02:05:47.026998","last_became_peered":"2024-04-25 02:05:47.026998","last_unstale":"2024-04-25 02:05:47.356151","last_undegraded":"2024-04-25 02:05:47.356151","last_fullsized":"2024-04-25 02:05:47.356151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388917","last_change":"2024-04-25 02:05:47.384104","last_active":"2024-04-25 02:05:47.388917","last_peered":"2024-04-25 02:05:47.388917","last_clean":"2024-04-25 02:05:47.388917","last_became_active":"2024-04-25 02:05:47.383783","last_became_peered":"2024-04-25 02:05:47.383783","last_unstale":"2024-04-25 02:05:47.388917","last_undegraded":"2024-04-25 02:05:47.388917","last_fullsized":"2024-04-25 02:05:47.388917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360990","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:05:47.360990","last_peered":"2024-04-25 02:05:47.360990","last_clean":"2024-04-25 02:05:47.360990","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:05:47.360990","last_undegraded":"2024-04-25 02:05:47.360990","last_fullsized":"2024-04-25 02:05:47.360990","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351208","last_change":"2024-04-25 02:05:47.013050","last_active":"2024-04-25 02:05:47.351208","last_peered":"2024-04-25 02:05:47.351208","last_clean":"2024-04-25 02:05:47.351208","last_became_active":"2024-04-25 02:05:47.012558","last_became_peered":"2024-04-25 02:05:47.012558","last_unstale":"2024-04-25 02:05:47.351208","last_undegraded":"2024-04-25 02:05:47.351208","last_fullsized":"2024-04-25 02:05:47.351208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373782","last_change":"2024-04-25 02:05:47.363093","last_active":"2024-04-25 02:05:47.373782","last_peered":"2024-04-25 02:05:47.373782","last_clean":"2024-04-25 02:05:47.373782","last_became_active":"2024-04-25 02:05:47.362753","last_became_peered":"2024-04-25 02:05:47.362753","last_unstale":"2024-04-25 02:05:47.373782","last_undegraded":"2024-04-25 02:05:47.373782","last_fullsized":"2024-04-25 02:05:47.373782","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352385","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:05:47.352385","last_peered":"2024-04-25 02:05:47.352385","last_clean":"2024-04-25 02:05:47.352385","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:05:47.352385","last_undegraded":"2024-04-25 02:05:47.352385","last_fullsized":"2024-04-25 02:05:47.352385","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356625","last_change":"2024-04-25 02:05:47.018087","last_active":"2024-04-25 02:05:47.356625","last_peered":"2024-04-25 02:05:47.356625","last_clean":"2024-04-25 02:05:47.356625","last_became_active":"2024-04-25 02:05:47.017799","last_became_peered":"2024-04-25 02:05:47.017799","last_unstale":"2024-04-25 02:05:47.356625","last_undegraded":"2024-04-25 02:05:47.356625","last_fullsized":"2024-04-25 02:05:47.356625","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387244","last_change":"2024-04-25 02:05:47.375657","last_active":"2024-04-25 02:05:47.387244","last_peered":"2024-04-25 02:05:47.387244","last_clean":"2024-04-25 02:05:47.387244","last_became_active":"2024-04-25 02:05:47.375334","last_became_peered":"2024-04-25 02:05:47.375334","last_unstale":"2024-04-25 02:05:47.387244","last_undegraded":"2024-04-25 02:05:47.387244","last_fullsized":"2024-04-25 02:05:47.387244","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357499","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:05:47.357499","last_peered":"2024-04-25 02:05:47.357499","last_clean":"2024-04-25 02:05:47.357499","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:05:47.357499","last_undegraded":"2024-04-25 02:05:47.357499","last_fullsized":"2024-04-25 02:05:47.357499","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358000","last_change":"2024-04-25 02:05:47.029097","last_active":"2024-04-25 02:05:47.358000","last_peered":"2024-04-25 02:05:47.358000","last_clean":"2024-04-25 02:05:47.358000","last_became_active":"2024-04-25 02:05:47.025880","last_became_peered":"2024-04-25 02:05:47.025880","last_unstale":"2024-04-25 02:05:47.358000","last_undegraded":"2024-04-25 02:05:47.358000","last_fullsized":"2024-04-25 02:05:47.358000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390611","last_change":"2024-04-25 02:05:47.384976","last_active":"2024-04-25 02:05:47.390611","last_peered":"2024-04-25 02:05:47.390611","last_clean":"2024-04-25 02:05:47.390611","last_became_active":"2024-04-25 02:05:47.384672","last_became_peered":"2024-04-25 02:05:47.384672","last_unstale":"2024-04-25 02:05:47.390611","last_undegraded":"2024-04-25 02:05:47.390611","last_fullsized":"2024-04-25 02:05:47.390611","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360865","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:05:47.360865","last_peered":"2024-04-25 02:05:47.360865","last_clean":"2024-04-25 02:05:47.360865","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:05:47.360865","last_undegraded":"2024-04-25 02:05:47.360865","last_fullsized":"2024-04-25 02:05:47.360865","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359901","last_change":"2024-04-25 02:05:47.026109","last_active":"2024-04-25 02:05:47.359901","last_peered":"2024-04-25 02:05:47.359901","last_clean":"2024-04-25 02:05:47.359901","last_became_active":"2024-04-25 02:05:47.025764","last_became_peered":"2024-04-25 02:05:47.025764","last_unstale":"2024-04-25 02:05:47.359901","last_undegraded":"2024-04-25 02:05:47.359901","last_fullsized":"2024-04-25 02:05:47.359901","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382178","last_change":"2024-04-25 02:05:47.377843","last_active":"2024-04-25 02:05:47.382178","last_peered":"2024-04-25 02:05:47.382178","last_clean":"2024-04-25 02:05:47.382178","last_became_active":"2024-04-25 02:05:47.377538","last_became_peered":"2024-04-25 02:05:47.377538","last_unstale":"2024-04-25 02:05:47.382178","last_undegraded":"2024-04-25 02:05:47.382178","last_fullsized":"2024-04-25 02:05:47.382178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352612","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:05:47.352612","last_peered":"2024-04-25 02:05:47.352612","last_clean":"2024-04-25 02:05:47.352612","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:05:47.352612","last_undegraded":"2024-04-25 02:05:47.352612","last_fullsized":"2024-04-25 02:05:47.352612","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354313","last_change":"2024-04-25 02:05:47.004781","last_active":"2024-04-25 02:05:47.354313","last_peered":"2024-04-25 02:05:47.354313","last_clean":"2024-04-25 02:05:47.354313","last_became_active":"2024-04-25 02:05:47.004453","last_became_peered":"2024-04-25 02:05:47.004453","last_unstale":"2024-04-25 02:05:47.354313","last_undegraded":"2024-04-25 02:05:47.354313","last_fullsized":"2024-04-25 02:05:47.354313","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380248","last_change":"2024-04-25 02:05:47.376611","last_active":"2024-04-25 02:05:47.380248","last_peered":"2024-04-25 02:05:47.380248","last_clean":"2024-04-25 02:05:47.380248","last_became_active":"2024-04-25 02:05:47.376284","last_became_peered":"2024-04-25 02:05:47.376284","last_unstale":"2024-04-25 02:05:47.380248","last_undegraded":"2024-04-25 02:05:47.380248","last_fullsized":"2024-04-25 02:05:47.380248","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389945","last_change":"2024-04-25 02:05:47.387545","last_active":"2024-04-25 02:05:47.389945","last_peered":"2024-04-25 02:05:47.389945","last_clean":"2024-04-25 02:05:47.389945","last_became_active":"2024-04-25 02:05:47.387246","last_became_peered":"2024-04-25 02:05:47.387246","last_unstale":"2024-04-25 02:05:47.389945","last_undegraded":"2024-04-25 02:05:47.389945","last_fullsized":"2024-04-25 02:05:47.389945","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361706","last_change":"2024-04-25 02:05:47.006606","last_active":"2024-04-25 02:05:47.361706","last_peered":"2024-04-25 02:05:47.361706","last_clean":"2024-04-25 02:05:47.361706","last_became_active":"2024-04-25 02:05:47.006296","last_became_peered":"2024-04-25 02:05:47.006296","last_unstale":"2024-04-25 02:05:47.361706","last_undegraded":"2024-04-25 02:05:47.361706","last_fullsized":"2024-04-25 02:05:47.361706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387972","last_change":"2024-04-25 02:05:47.381933","last_active":"2024-04-25 02:05:47.387972","last_peered":"2024-04-25 02:05:47.387972","last_clean":"2024-04-25 02:05:47.387972","last_became_active":"2024-04-25 02:05:47.379588","last_became_peered":"2024-04-25 02:05:47.379588","last_unstale":"2024-04-25 02:05:47.387972","last_undegraded":"2024-04-25 02:05:47.387972","last_fullsized":"2024-04-25 02:05:47.387972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378078","last_change":"2024-04-25 02:05:47.008840","last_active":"2024-04-25 02:05:47.378078","last_peered":"2024-04-25 02:05:47.378078","last_clean":"2024-04-25 02:05:47.378078","last_became_active":"2024-04-25 02:05:47.008521","last_became_peered":"2024-04-25 02:05:47.008521","last_unstale":"2024-04-25 02:05:47.378078","last_undegraded":"2024-04-25 02:05:47.378078","last_fullsized":"2024-04-25 02:05:47.378078","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385090","last_change":"2024-04-25 02:05:47.378449","last_active":"2024-04-25 02:05:47.385090","last_peered":"2024-04-25 02:05:47.385090","last_clean":"2024-04-25 02:05:47.385090","last_became_active":"2024-04-25 02:05:47.371394","last_became_peered":"2024-04-25 02:05:47.371394","last_unstale":"2024-04-25 02:05:47.385090","last_undegraded":"2024-04-25 02:05:47.385090","last_fullsized":"2024-04-25 02:05:47.385090","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389698","last_change":"2024-04-25 02:05:47.021735","last_active":"2024-04-25 02:05:47.389698","last_peered":"2024-04-25 02:05:47.389698","last_clean":"2024-04-25 02:05:47.389698","last_became_active":"2024-04-25 02:05:47.021400","last_became_peered":"2024-04-25 02:05:47.021400","last_unstale":"2024-04-25 02:05:47.389698","last_undegraded":"2024-04-25 02:05:47.389698","last_fullsized":"2024-04-25 02:05:47.389698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389987","last_change":"2024-04-25 02:05:47.383033","last_active":"2024-04-25 02:05:47.389987","last_peered":"2024-04-25 02:05:47.389987","last_clean":"2024-04-25 02:05:47.389987","last_became_active":"2024-04-25 02:05:47.382717","last_became_peered":"2024-04-25 02:05:47.382717","last_unstale":"2024-04-25 02:05:47.389987","last_undegraded":"2024-04-25 02:05:47.389987","last_fullsized":"2024-04-25 02:05:47.389987","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389376","last_change":"2024-04-25 02:05:47.014112","last_active":"2024-04-25 02:05:47.389376","last_peered":"2024-04-25 02:05:47.389376","last_clean":"2024-04-25 02:05:47.389376","last_became_active":"2024-04-25 02:05:47.013624","last_became_peered":"2024-04-25 02:05:47.013624","last_unstale":"2024-04-25 02:05:47.389376","last_undegraded":"2024-04-25 02:05:47.389376","last_fullsized":"2024-04-25 02:05:47.389376","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380606","last_change":"2024-04-25 02:05:47.373843","last_active":"2024-04-25 02:05:47.380606","last_peered":"2024-04-25 02:05:47.380606","last_clean":"2024-04-25 02:05:47.380606","last_became_active":"2024-04-25 02:05:47.369284","last_became_peered":"2024-04-25 02:05:47.369284","last_unstale":"2024-04-25 02:05:47.380606","last_undegraded":"2024-04-25 02:05:47.380606","last_fullsized":"2024-04-25 02:05:47.380606","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356604","last_change":"2024-04-25 02:05:47.028330","last_active":"2024-04-25 02:05:47.356604","last_peered":"2024-04-25 02:05:47.356604","last_clean":"2024-04-25 02:05:47.356604","last_became_active":"2024-04-25 02:05:47.027257","last_became_peered":"2024-04-25 02:05:47.027257","last_unstale":"2024-04-25 02:05:47.356604","last_undegraded":"2024-04-25 02:05:47.356604","last_fullsized":"2024-04-25 02:05:47.356604","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.375879","last_change":"2024-04-25 02:05:47.366400","last_active":"2024-04-25 02:05:47.375879","last_peered":"2024-04-25 02:05:47.375879","last_clean":"2024-04-25 02:05:47.375879","last_became_active":"2024-04-25 02:05:47.366000","last_became_peered":"2024-04-25 02:05:47.366000","last_unstale":"2024-04-25 02:05:47.375879","last_undegraded":"2024-04-25 02:05:47.375879","last_fullsized":"2024-04-25 02:05:47.375879","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351200","last_change":"2024-04-25 02:05:46.999953","last_active":"2024-04-25 02:05:47.351200","last_peered":"2024-04-25 02:05:47.351200","last_clean":"2024-04-25 02:05:47.351200","last_became_active":"2024-04-25 02:05:46.999606","last_became_peered":"2024-04-25 02:05:46.999606","last_unstale":"2024-04-25 02:05:47.351200","last_undegraded":"2024-04-25 02:05:47.351200","last_fullsized":"2024-04-25 02:05:47.351200","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387617","last_change":"2024-04-25 02:05:47.381525","last_active":"2024-04-25 02:05:47.387617","last_peered":"2024-04-25 02:05:47.387617","last_clean":"2024-04-25 02:05:47.387617","last_became_active":"2024-04-25 02:05:47.378390","last_became_peered":"2024-04-25 02:05:47.378390","last_unstale":"2024-04-25 02:05:47.387617","last_undegraded":"2024-04-25 02:05:47.387617","last_fullsized":"2024-04-25 02:05:47.387617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363760","last_change":"2024-04-25 02:05:47.026754","last_active":"2024-04-25 02:05:47.363760","last_peered":"2024-04-25 02:05:47.363760","last_clean":"2024-04-25 02:05:47.363760","last_became_active":"2024-04-25 02:05:47.026391","last_became_peered":"2024-04-25 02:05:47.026391","last_unstale":"2024-04-25 02:05:47.363760","last_undegraded":"2024-04-25 02:05:47.363760","last_fullsized":"2024-04-25 02:05:47.363760","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388695","last_change":"2024-04-25 02:05:47.379347","last_active":"2024-04-25 02:05:47.388695","last_peered":"2024-04-25 02:05:47.388695","last_clean":"2024-04-25 02:05:47.388695","last_became_active":"2024-04-25 02:05:47.379040","last_became_peered":"2024-04-25 02:05:47.379040","last_unstale":"2024-04-25 02:05:47.388695","last_undegraded":"2024-04-25 02:05:47.388695","last_fullsized":"2024-04-25 02:05:47.388695","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358961","last_change":"2024-04-25 02:05:47.027710","last_active":"2024-04-25 02:05:47.358961","last_peered":"2024-04-25 02:05:47.358961","last_clean":"2024-04-25 02:05:47.358961","last_became_active":"2024-04-25 02:05:47.027316","last_became_peered":"2024-04-25 02:05:47.027316","last_unstale":"2024-04-25 02:05:47.358961","last_undegraded":"2024-04-25 02:05:47.358961","last_fullsized":"2024-04-25 02:05:47.358961","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374780","last_change":"2024-04-25 02:05:47.372923","last_active":"2024-04-25 02:05:47.374780","last_peered":"2024-04-25 02:05:47.374780","last_clean":"2024-04-25 02:05:47.374780","last_became_active":"2024-04-25 02:05:47.372581","last_became_peered":"2024-04-25 02:05:47.372581","last_unstale":"2024-04-25 02:05:47.374780","last_undegraded":"2024-04-25 02:05:47.374780","last_fullsized":"2024-04-25 02:05:47.374780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354411","last_change":"2024-04-25 02:05:47.004609","last_active":"2024-04-25 02:05:47.354411","last_peered":"2024-04-25 02:05:47.354411","last_clean":"2024-04-25 02:05:47.354411","last_became_active":"2024-04-25 02:05:47.001832","last_became_peered":"2024-04-25 02:05:47.001832","last_unstale":"2024-04-25 02:05:47.354411","last_undegraded":"2024-04-25 02:05:47.354411","last_fullsized":"2024-04-25 02:05:47.354411","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390986","last_change":"2024-04-25 02:05:47.380256","last_active":"2024-04-25 02:05:47.390986","last_peered":"2024-04-25 02:05:47.390986","last_clean":"2024-04-25 02:05:47.390986","last_became_active":"2024-04-25 02:05:47.379963","last_became_peered":"2024-04-25 02:05:47.379963","last_unstale":"2024-04-25 02:05:47.390986","last_undegraded":"2024-04-25 02:05:47.390986","last_fullsized":"2024-04-25 02:05:47.390986","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352630","last_change":"2024-04-25 02:05:46.996348","last_active":"2024-04-25 02:05:47.352630","last_peered":"2024-04-25 02:05:47.352630","last_clean":"2024-04-25 02:05:47.352630","last_became_active":"2024-04-25 02:05:46.996069","last_became_peered":"2024-04-25 02:05:46.996069","last_unstale":"2024-04-25 02:05:47.352630","last_undegraded":"2024-04-25 02:05:47.352630","last_fullsized":"2024-04-25 02:05:47.352630","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389206","last_change":"2024-04-25 02:05:47.382589","last_active":"2024-04-25 02:05:47.389206","last_peered":"2024-04-25 02:05:47.389206","last_clean":"2024-04-25 02:05:47.389206","last_became_active":"2024-04-25 02:05:47.382307","last_became_peered":"2024-04-25 02:05:47.382307","last_unstale":"2024-04-25 02:05:47.389206","last_undegraded":"2024-04-25 02:05:47.389206","last_fullsized":"2024-04-25 02:05:47.389206","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-04-25 02:05:48.371682","last_change":"2024-04-25 02:05:46.999274","last_active":"2024-04-25 02:05:48.371682","last_peered":"2024-04-25 02:05:48.371682","last_clean":"2024-04-25 02:05:48.371682","last_became_active":"2024-04-25 02:05:46.998876","last_became_peered":"2024-04-25 02:05:46.998876","last_unstale":"2024-04-25 02:05:48.371682","last_undegraded":"2024-04-25 02:05:48.371682","last_fullsized":"2024-04-25 02:05:48.371682","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382025","last_change":"2024-04-25 02:05:47.377487","last_active":"2024-04-25 02:05:47.382025","last_peered":"2024-04-25 02:05:47.382025","last_clean":"2024-04-25 02:05:47.382025","last_became_active":"2024-04-25 02:05:47.376770","last_became_peered":"2024-04-25 02:05:47.376770","last_unstale":"2024-04-25 02:05:47.382025","last_undegraded":"2024-04-25 02:05:47.382025","last_fullsized":"2024-04-25 02:05:47.382025","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361361","last_change":"2024-04-25 02:05:47.026964","last_active":"2024-04-25 02:05:47.361361","last_peered":"2024-04-25 02:05:47.361361","last_clean":"2024-04-25 02:05:47.361361","last_became_active":"2024-04-25 02:05:47.026604","last_became_peered":"2024-04-25 02:05:47.026604","last_unstale":"2024-04-25 02:05:47.361361","last_undegraded":"2024-04-25 02:05:47.361361","last_fullsized":"2024-04-25 02:05:47.361361","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386703","last_change":"2024-04-25 02:05:47.375591","last_active":"2024-04-25 02:05:47.386703","last_peered":"2024-04-25 02:05:47.386703","last_clean":"2024-04-25 02:05:47.386703","last_became_active":"2024-04-25 02:05:47.375271","last_became_peered":"2024-04-25 02:05:47.375271","last_unstale":"2024-04-25 02:05:47.386703","last_undegraded":"2024-04-25 02:05:47.386703","last_fullsized":"2024-04-25 02:05:47.386703","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362340","last_change":"2024-04-25 02:05:47.028567","last_active":"2024-04-25 02:05:47.362340","last_peered":"2024-04-25 02:05:47.362340","last_clean":"2024-04-25 02:05:47.362340","last_became_active":"2024-04-25 02:05:47.027520","last_became_peered":"2024-04-25 02:05:47.027520","last_unstale":"2024-04-25 02:05:47.362340","last_undegraded":"2024-04-25 02:05:47.362340","last_fullsized":"2024-04-25 02:05:47.362340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387289","last_change":"2024-04-25 02:05:47.376362","last_active":"2024-04-25 02:05:47.387289","last_peered":"2024-04-25 02:05:47.387289","last_clean":"2024-04-25 02:05:47.387289","last_became_active":"2024-04-25 02:05:47.376045","last_became_peered":"2024-04-25 02:05:47.376045","last_unstale":"2024-04-25 02:05:47.387289","last_undegraded":"2024-04-25 02:05:47.387289","last_fullsized":"2024-04-25 02:05:47.387289","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351558","last_change":"2024-04-25 02:05:47.018376","last_active":"2024-04-25 02:05:47.351558","last_peered":"2024-04-25 02:05:47.351558","last_clean":"2024-04-25 02:05:47.351558","last_became_active":"2024-04-25 02:05:47.018044","last_became_peered":"2024-04-25 02:05:47.018044","last_unstale":"2024-04-25 02:05:47.351558","last_undegraded":"2024-04-25 02:05:47.351558","last_fullsized":"2024-04-25 02:05:47.351558","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389103","last_change":"2024-04-25 02:05:47.384783","last_active":"2024-04-25 02:05:47.389103","last_peered":"2024-04-25 02:05:47.389103","last_clean":"2024-04-25 02:05:47.389103","last_became_active":"2024-04-25 02:05:47.384440","last_became_peered":"2024-04-25 02:05:47.384440","last_unstale":"2024-04-25 02:05:47.389103","last_undegraded":"2024-04-25 02:05:47.389103","last_fullsized":"2024-04-25 02:05:47.389103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352883","last_change":"2024-04-25 02:05:47.000733","last_active":"2024-04-25 02:05:47.352883","last_peered":"2024-04-25 02:05:47.352883","last_clean":"2024-04-25 02:05:47.352883","last_became_active":"2024-04-25 02:05:47.000381","last_became_peered":"2024-04-25 02:05:47.000381","last_unstale":"2024-04-25 02:05:47.352883","last_undegraded":"2024-04-25 02:05:47.352883","last_fullsized":"2024-04-25 02:05:47.352883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372954","last_change":"2024-04-25 02:05:47.363717","last_active":"2024-04-25 02:05:47.372954","last_peered":"2024-04-25 02:05:47.372954","last_clean":"2024-04-25 02:05:47.372954","last_became_active":"2024-04-25 02:05:47.363378","last_became_peered":"2024-04-25 02:05:47.363378","last_unstale":"2024-04-25 02:05:47.372954","last_undegraded":"2024-04-25 02:05:47.372954","last_fullsized":"2024-04-25 02:05:47.372954","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377804","last_change":"2024-04-25 02:05:46.996992","last_active":"2024-04-25 02:05:47.377804","last_peered":"2024-04-25 02:05:47.377804","last_clean":"2024-04-25 02:05:47.377804","last_became_active":"2024-04-25 02:05:46.996648","last_became_peered":"2024-04-25 02:05:46.996648","last_unstale":"2024-04-25 02:05:47.377804","last_undegraded":"2024-04-25 02:05:47.377804","last_fullsized":"2024-04-25 02:05:47.377804","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389212","last_change":"2024-04-25 02:05:47.380340","last_active":"2024-04-25 02:05:47.389212","last_peered":"2024-04-25 02:05:47.389212","last_clean":"2024-04-25 02:05:47.389212","last_became_active":"2024-04-25 02:05:47.380051","last_became_peered":"2024-04-25 02:05:47.380051","last_unstale":"2024-04-25 02:05:47.389212","last_undegraded":"2024-04-25 02:05:47.389212","last_fullsized":"2024-04-25 02:05:47.389212","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351619","last_change":"2024-04-25 02:05:46.999913","last_active":"2024-04-25 02:05:47.351619","last_peered":"2024-04-25 02:05:47.351619","last_clean":"2024-04-25 02:05:47.351619","last_became_active":"2024-04-25 02:05:46.999553","last_became_peered":"2024-04-25 02:05:46.999553","last_unstale":"2024-04-25 02:05:47.351619","last_undegraded":"2024-04-25 02:05:47.351619","last_fullsized":"2024-04-25 02:05:47.351619","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384258","last_change":"2024-04-25 02:05:47.377775","last_active":"2024-04-25 02:05:47.384258","last_peered":"2024-04-25 02:05:47.384258","last_clean":"2024-04-25 02:05:47.384258","last_became_active":"2024-04-25 02:05:47.377456","last_became_peered":"2024-04-25 02:05:47.377456","last_unstale":"2024-04-25 02:05:47.384258","last_undegraded":"2024-04-25 02:05:47.384258","last_fullsized":"2024-04-25 02:05:47.384258","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389886","last_change":"2024-04-25 02:05:47.022408","last_active":"2024-04-25 02:05:47.389886","last_peered":"2024-04-25 02:05:47.389886","last_clean":"2024-04-25 02:05:47.389886","last_became_active":"2024-04-25 02:05:47.022145","last_became_peered":"2024-04-25 02:05:47.022145","last_unstale":"2024-04-25 02:05:47.389886","last_undegraded":"2024-04-25 02:05:47.389886","last_fullsized":"2024-04-25 02:05:47.389886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389273","last_change":"2024-04-25 02:05:47.383157","last_active":"2024-04-25 02:05:47.389273","last_peered":"2024-04-25 02:05:47.389273","last_clean":"2024-04-25 02:05:47.389273","last_became_active":"2024-04-25 02:05:47.382824","last_became_peered":"2024-04-25 02:05:47.382824","last_unstale":"2024-04-25 02:05:47.389273","last_undegraded":"2024-04-25 02:05:47.389273","last_fullsized":"2024-04-25 02:05:47.389273","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353638","last_change":"2024-04-25 02:05:46.999652","last_active":"2024-04-25 02:05:47.353638","last_peered":"2024-04-25 02:05:47.353638","last_clean":"2024-04-25 02:05:47.353638","last_became_active":"2024-04-25 02:05:46.999330","last_became_peered":"2024-04-25 02:05:46.999330","last_unstale":"2024-04-25 02:05:47.353638","last_undegraded":"2024-04-25 02:05:47.353638","last_fullsized":"2024-04-25 02:05:47.353638","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382043","last_change":"2024-04-25 02:05:47.377666","last_active":"2024-04-25 02:05:47.382043","last_peered":"2024-04-25 02:05:47.382043","last_clean":"2024-04-25 02:05:47.382043","last_became_active":"2024-04-25 02:05:47.376996","last_became_peered":"2024-04-25 02:05:47.376996","last_unstale":"2024-04-25 02:05:47.382043","last_undegraded":"2024-04-25 02:05:47.382043","last_fullsized":"2024-04-25 02:05:47.382043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361467","last_change":"2024-04-25 02:05:47.026476","last_active":"2024-04-25 02:05:47.361467","last_peered":"2024-04-25 02:05:47.361467","last_clean":"2024-04-25 02:05:47.361467","last_became_active":"2024-04-25 02:05:47.025938","last_became_peered":"2024-04-25 02:05:47.025938","last_unstale":"2024-04-25 02:05:47.361467","last_undegraded":"2024-04-25 02:05:47.361467","last_fullsized":"2024-04-25 02:05:47.361467","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373149","last_change":"2024-04-25 02:05:47.368468","last_active":"2024-04-25 02:05:47.373149","last_peered":"2024-04-25 02:05:47.373149","last_clean":"2024-04-25 02:05:47.373149","last_became_active":"2024-04-25 02:05:47.368132","last_became_peered":"2024-04-25 02:05:47.368132","last_unstale":"2024-04-25 02:05:47.373149","last_undegraded":"2024-04-25 02:05:47.373149","last_fullsized":"2024-04-25 02:05:47.373149","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388094","last_change":"2024-04-25 02:05:47.009725","last_active":"2024-04-25 02:05:47.388094","last_peered":"2024-04-25 02:05:47.388094","last_clean":"2024-04-25 02:05:47.388094","last_became_active":"2024-04-25 02:05:47.007964","last_became_peered":"2024-04-25 02:05:47.007964","last_unstale":"2024-04-25 02:05:47.388094","last_undegraded":"2024-04-25 02:05:47.388094","last_fullsized":"2024-04-25 02:05:47.388094","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388711","last_change":"2024-04-25 02:05:47.379616","last_active":"2024-04-25 02:05:47.388711","last_peered":"2024-04-25 02:05:47.388711","last_clean":"2024-04-25 02:05:47.388711","last_became_active":"2024-04-25 02:05:47.379103","last_became_peered":"2024-04-25 02:05:47.379103","last_unstale":"2024-04-25 02:05:47.388711","last_undegraded":"2024-04-25 02:05:47.388711","last_fullsized":"2024-04-25 02:05:47.388711","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360333","last_change":"2024-04-25 02:05:47.009452","last_active":"2024-04-25 02:05:47.360333","last_peered":"2024-04-25 02:05:47.360333","last_clean":"2024-04-25 02:05:47.360333","last_became_active":"2024-04-25 02:05:47.009116","last_became_peered":"2024-04-25 02:05:47.009116","last_unstale":"2024-04-25 02:05:47.360333","last_undegraded":"2024-04-25 02:05:47.360333","last_fullsized":"2024-04-25 02:05:47.360333","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389963","last_change":"2024-04-25 02:05:47.386054","last_active":"2024-04-25 02:05:47.389963","last_peered":"2024-04-25 02:05:47.389963","last_clean":"2024-04-25 02:05:47.389963","last_became_active":"2024-04-25 02:05:47.383311","last_became_peered":"2024-04-25 02:05:47.383311","last_unstale":"2024-04-25 02:05:47.389963","last_undegraded":"2024-04-25 02:05:47.389963","last_fullsized":"2024-04-25 02:05:47.389963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351815","last_change":"2024-04-25 02:05:47.020004","last_active":"2024-04-25 02:05:47.351815","last_peered":"2024-04-25 02:05:47.351815","last_clean":"2024-04-25 02:05:47.351815","last_became_active":"2024-04-25 02:05:47.019687","last_became_peered":"2024-04-25 02:05:47.019687","last_unstale":"2024-04-25 02:05:47.351815","last_undegraded":"2024-04-25 02:05:47.351815","last_fullsized":"2024-04-25 02:05:47.351815","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377719","last_change":"2024-04-25 02:05:47.365437","last_active":"2024-04-25 02:05:47.377719","last_peered":"2024-04-25 02:05:47.377719","last_clean":"2024-04-25 02:05:47.377719","last_became_active":"2024-04-25 02:05:47.365101","last_became_peered":"2024-04-25 02:05:47.365101","last_unstale":"2024-04-25 02:05:47.377719","last_undegraded":"2024-04-25 02:05:47.377719","last_fullsized":"2024-04-25 02:05:47.377719","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374047","last_change":"2024-04-25 02:05:46.993531","last_active":"2024-04-25 02:05:47.374047","last_peered":"2024-04-25 02:05:47.374047","last_clean":"2024-04-25 02:05:47.374047","last_became_active":"2024-04-25 02:05:46.993117","last_became_peered":"2024-04-25 02:05:46.993117","last_unstale":"2024-04-25 02:05:47.374047","last_undegraded":"2024-04-25 02:05:47.374047","last_fullsized":"2024-04-25 02:05:47.374047","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390894","last_change":"2024-04-25 02:05:47.385729","last_active":"2024-04-25 02:05:47.390894","last_peered":"2024-04-25 02:05:47.390894","last_clean":"2024-04-25 02:05:47.390894","last_became_active":"2024-04-25 02:05:47.385421","last_became_peered":"2024-04-25 02:05:47.385421","last_unstale":"2024-04-25 02:05:47.390894","last_undegraded":"2024-04-25 02:05:47.390894","last_fullsized":"2024-04-25 02:05:47.390894","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391988","last_change":"2024-04-25 02:05:47.020323","last_active":"2024-04-25 02:05:47.391988","last_peered":"2024-04-25 02:05:47.391988","last_clean":"2024-04-25 02:05:47.391988","last_became_active":"2024-04-25 02:05:47.019973","last_became_peered":"2024-04-25 02:05:47.019973","last_unstale":"2024-04-25 02:05:47.391988","last_undegraded":"2024-04-25 02:05:47.391988","last_fullsized":"2024-04-25 02:05:47.391988","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384226","last_change":"2024-04-25 02:05:47.375256","last_active":"2024-04-25 02:05:47.384226","last_peered":"2024-04-25 02:05:47.384226","last_clean":"2024-04-25 02:05:47.384226","last_became_active":"2024-04-25 02:05:47.374920","last_became_peered":"2024-04-25 02:05:47.374920","last_unstale":"2024-04-25 02:05:47.384226","last_undegraded":"2024-04-25 02:05:47.384226","last_fullsized":"2024-04-25 02:05:47.384226","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353210","last_change":"2024-04-25 02:05:46.995620","last_active":"2024-04-25 02:05:47.353210","last_peered":"2024-04-25 02:05:47.353210","last_clean":"2024-04-25 02:05:47.353210","last_became_active":"2024-04-25 02:05:46.995117","last_became_peered":"2024-04-25 02:05:46.995117","last_unstale":"2024-04-25 02:05:47.353210","last_undegraded":"2024-04-25 02:05:47.353210","last_fullsized":"2024-04-25 02:05:47.353210","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374027","last_change":"2024-04-25 02:05:47.372331","last_active":"2024-04-25 02:05:47.374027","last_peered":"2024-04-25 02:05:47.374027","last_clean":"2024-04-25 02:05:47.374027","last_became_active":"2024-04-25 02:05:47.372004","last_became_peered":"2024-04-25 02:05:47.372004","last_unstale":"2024-04-25 02:05:47.374027","last_undegraded":"2024-04-25 02:05:47.374027","last_fullsized":"2024-04-25 02:05:47.374027","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353418","last_change":"2024-04-25 02:05:46.999650","last_active":"2024-04-25 02:05:47.353418","last_peered":"2024-04-25 02:05:47.353418","last_clean":"2024-04-25 02:05:47.353418","last_became_active":"2024-04-25 02:05:46.999284","last_became_peered":"2024-04-25 02:05:46.999284","last_unstale":"2024-04-25 02:05:47.353418","last_undegraded":"2024-04-25 02:05:47.353418","last_fullsized":"2024-04-25 02:05:47.353418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386278","last_change":"2024-04-25 02:05:47.380781","last_active":"2024-04-25 02:05:47.386278","last_peered":"2024-04-25 02:05:47.386278","last_clean":"2024-04-25 02:05:47.386278","last_became_active":"2024-04-25 02:05:47.380462","last_became_peered":"2024-04-25 02:05:47.380462","last_unstale":"2024-04-25 02:05:47.386278","last_undegraded":"2024-04-25 02:05:47.386278","last_fullsized":"2024-04-25 02:05:47.386278","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362868","last_change":"2024-04-25 02:05:47.001836","last_active":"2024-04-25 02:05:47.362868","last_peered":"2024-04-25 02:05:47.362868","last_clean":"2024-04-25 02:05:47.362868","last_became_active":"2024-04-25 02:05:47.001509","last_became_peered":"2024-04-25 02:05:47.001509","last_unstale":"2024-04-25 02:05:47.362868","last_undegraded":"2024-04-25 02:05:47.362868","last_fullsized":"2024-04-25 02:05:47.362868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383697","last_change":"2024-04-25 02:05:47.373785","last_active":"2024-04-25 02:05:47.383697","last_peered":"2024-04-25 02:05:47.383697","last_clean":"2024-04-25 02:05:47.383697","last_became_active":"2024-04-25 02:05:47.371646","last_became_peered":"2024-04-25 02:05:47.371646","last_unstale":"2024-04-25 02:05:47.383697","last_undegraded":"2024-04-25 02:05:47.383697","last_fullsized":"2024-04-25 02:05:47.383697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359221","last_change":"2024-04-25 02:05:47.009028","last_active":"2024-04-25 02:05:47.359221","last_peered":"2024-04-25 02:05:47.359221","last_clean":"2024-04-25 02:05:47.359221","last_became_active":"2024-04-25 02:05:47.007728","last_became_peered":"2024-04-25 02:05:47.007728","last_unstale":"2024-04-25 02:05:47.359221","last_undegraded":"2024-04-25 02:05:47.359221","last_fullsized":"2024-04-25 02:05:47.359221","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390062","last_change":"2024-04-25 02:05:47.386599","last_active":"2024-04-25 02:05:47.390062","last_peered":"2024-04-25 02:05:47.390062","last_clean":"2024-04-25 02:05:47.390062","last_became_active":"2024-04-25 02:05:47.383052","last_became_peered":"2024-04-25 02:05:47.383052","last_unstale":"2024-04-25 02:05:47.390062","last_undegraded":"2024-04-25 02:05:47.390062","last_fullsized":"2024-04-25 02:05:47.390062","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351457","last_change":"2024-04-25 02:05:46.992970","last_active":"2024-04-25 02:05:47.351457","last_peered":"2024-04-25 02:05:47.351457","last_clean":"2024-04-25 02:05:47.351457","last_became_active":"2024-04-25 02:05:46.992580","last_became_peered":"2024-04-25 02:05:46.992580","last_unstale":"2024-04-25 02:05:47.351457","last_undegraded":"2024-04-25 02:05:47.351457","last_fullsized":"2024-04-25 02:05:47.351457","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390594","last_change":"2024-04-25 02:05:47.384947","last_active":"2024-04-25 02:05:47.390594","last_peered":"2024-04-25 02:05:47.390594","last_clean":"2024-04-25 02:05:47.390594","last_became_active":"2024-04-25 02:05:47.384477","last_became_peered":"2024-04-25 02:05:47.384477","last_unstale":"2024-04-25 02:05:47.390594","last_undegraded":"2024-04-25 02:05:47.390594","last_fullsized":"2024-04-25 02:05:47.390594","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390564","last_change":"2024-04-25 02:05:47.016029","last_active":"2024-04-25 02:05:47.390564","last_peered":"2024-04-25 02:05:47.390564","last_clean":"2024-04-25 02:05:47.390564","last_became_active":"2024-04-25 02:05:47.015470","last_became_peered":"2024-04-25 02:05:47.015470","last_unstale":"2024-04-25 02:05:47.390564","last_undegraded":"2024-04-25 02:05:47.390564","last_fullsized":"2024-04-25 02:05:47.390564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377970","last_change":"2024-04-25 02:05:47.368583","last_active":"2024-04-25 02:05:47.377970","last_peered":"2024-04-25 02:05:47.377970","last_clean":"2024-04-25 02:05:47.377970","last_became_active":"2024-04-25 02:05:47.366798","last_became_peered":"2024-04-25 02:05:47.366798","last_unstale":"2024-04-25 02:05:47.377970","last_undegraded":"2024-04-25 02:05:47.377970","last_fullsized":"2024-04-25 02:05:47.377970","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388229","last_change":"2024-04-25 02:05:47.005838","last_active":"2024-04-25 02:05:47.388229","last_peered":"2024-04-25 02:05:47.388229","last_clean":"2024-04-25 02:05:47.388229","last_became_active":"2024-04-25 02:05:47.005500","last_became_peered":"2024-04-25 02:05:47.005500","last_unstale":"2024-04-25 02:05:47.388229","last_undegraded":"2024-04-25 02:05:47.388229","last_fullsized":"2024-04-25 02:05:47.388229","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386313","last_change":"2024-04-25 02:05:47.380789","last_active":"2024-04-25 02:05:47.386313","last_peered":"2024-04-25 02:05:47.386313","last_clean":"2024-04-25 02:05:47.386313","last_became_active":"2024-04-25 02:05:47.380537","last_became_peered":"2024-04-25 02:05:47.380537","last_unstale":"2024-04-25 02:05:47.386313","last_undegraded":"2024-04-25 02:05:47.386313","last_fullsized":"2024-04-25 02:05:47.386313","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388104","last_change":"2024-04-25 02:05:47.006598","last_active":"2024-04-25 02:05:47.388104","last_peered":"2024-04-25 02:05:47.388104","last_clean":"2024-04-25 02:05:47.388104","last_became_active":"2024-04-25 02:05:47.006139","last_became_peered":"2024-04-25 02:05:47.006139","last_unstale":"2024-04-25 02:05:47.388104","last_undegraded":"2024-04-25 02:05:47.388104","last_fullsized":"2024-04-25 02:05:47.388104","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378165","last_change":"2024-04-25 02:05:47.374238","last_active":"2024-04-25 02:05:47.378165","last_peered":"2024-04-25 02:05:47.378165","last_clean":"2024-04-25 02:05:47.378165","last_became_active":"2024-04-25 02:05:47.373927","last_became_peered":"2024-04-25 02:05:47.373927","last_unstale":"2024-04-25 02:05:47.378165","last_undegraded":"2024-04-25 02:05:47.378165","last_fullsized":"2024-04-25 02:05:47.378165","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353045","last_change":"2024-04-25 02:05:47.003496","last_active":"2024-04-25 02:05:47.353045","last_peered":"2024-04-25 02:05:47.353045","last_clean":"2024-04-25 02:05:47.353045","last_became_active":"2024-04-25 02:05:47.002906","last_became_peered":"2024-04-25 02:05:47.002906","last_unstale":"2024-04-25 02:05:47.353045","last_undegraded":"2024-04-25 02:05:47.353045","last_fullsized":"2024-04-25 02:05:47.353045","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390790","last_change":"2024-04-25 02:05:47.385923","last_active":"2024-04-25 02:05:47.390790","last_peered":"2024-04-25 02:05:47.390790","last_clean":"2024-04-25 02:05:47.390790","last_became_active":"2024-04-25 02:05:47.385607","last_became_peered":"2024-04-25 02:05:47.385607","last_unstale":"2024-04-25 02:05:47.390790","last_undegraded":"2024-04-25 02:05:47.390790","last_fullsized":"2024-04-25 02:05:47.390790","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362831","last_change":"2024-04-25 02:05:46.999151","last_active":"2024-04-25 02:05:47.362831","last_peered":"2024-04-25 02:05:47.362831","last_clean":"2024-04-25 02:05:47.362831","last_became_active":"2024-04-25 02:05:46.998843","last_became_peered":"2024-04-25 02:05:46.998843","last_unstale":"2024-04-25 02:05:47.362831","last_undegraded":"2024-04-25 02:05:47.362831","last_fullsized":"2024-04-25 02:05:47.362831","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387468","last_change":"2024-04-25 02:05:47.381229","last_active":"2024-04-25 02:05:47.387468","last_peered":"2024-04-25 02:05:47.387468","last_clean":"2024-04-25 02:05:47.387468","last_became_active":"2024-04-25 02:05:47.380920","last_became_peered":"2024-04-25 02:05:47.380920","last_unstale":"2024-04-25 02:05:47.387468","last_undegraded":"2024-04-25 02:05:47.387468","last_fullsized":"2024-04-25 02:05:47.387468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385052","last_change":"2024-04-25 02:05:47.002796","last_active":"2024-04-25 02:05:47.385052","last_peered":"2024-04-25 02:05:47.385052","last_clean":"2024-04-25 02:05:47.385052","last_became_active":"2024-04-25 02:05:47.002460","last_became_peered":"2024-04-25 02:05:47.002460","last_unstale":"2024-04-25 02:05:47.385052","last_undegraded":"2024-04-25 02:05:47.385052","last_fullsized":"2024-04-25 02:05:47.385052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]}]}]}} 2024-04-25T02:05:54.934 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:05:54.934 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:05:54.935 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:05:54.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T02:05:54.935 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T02:05:55.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1abbb6f700 1 Processor -- start 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1abbb6f700 1 -- start start 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1abbb6f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab410b910 0x7f1ab41a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1abbb6f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41a59d0 0x7f1ab41a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1abbb6f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab410bd60 con 0x7f1ab40f5a10 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1abbb6f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40fa590 con 0x7f1ab41a59d0 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1abbb6f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41a0c50 con 0x7f1ab410b910 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1ab3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab410b910 0x7f1ab41a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1ab896a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1ab40f5a10 0x7f1ab410b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57566/0 (socket says 172.21.15.57:57566) 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1ab916b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41a59d0 0x7f1ab41a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.095 7f1ab896a700 1 -- 172.21.15.57:0/3157132078 learned_addr learned my addr 172.21.15.57:0/3157132078 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab3fff700 1 -- 172.21.15.57:0/3157132078 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41a59d0 msgr2=0x7f1ab41a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:55.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab3fff700 1 --2- 172.21.15.57:0/3157132078 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41a59d0 0x7f1ab41a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab37fe700 1 -- 172.21.15.57:0/3157132078 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584048530 0 0) 0x7f1aac001490 con 0x7f1ab40f5a10 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab3fff700 1 -- 172.21.15.57:0/3157132078 >> v1:172.21.15.57:6789/0 conn(0x7f1ab40f5a10 legacy=0x7f1ab410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab3fff700 1 -- 172.21.15.57:0/3157132078 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab41a9470 con 0x7f1ab410b910 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab916b700 1 --2- 172.21.15.57:0/3157132078 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41a59d0 0x7f1ab41a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab3fff700 1 --2- 172.21.15.57:0/3157132078 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab410b910 0x7f1ab41a53a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1ab40f47c0 tx=0x7f1a9c00b9d0).ready entity=mon.2 client_cookie=c6a4ee8d51c27801 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab37fe700 1 -- 172.21.15.57:0/3157132078 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ab41a9470 con 0x7f1ab410b910 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab37fe700 1 -- 172.21.15.57:0/3157132078 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00d570 con 0x7f1ab410b910 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1ab37fe700 1 -- 172.21.15.57:0/3157132078 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a9c00d940 con 0x7f1ab410b910 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1abbb6f700 1 -- 172.21.15.57:0/3157132078 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab410b910 msgr2=0x7f1ab41a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.096 7f1abbb6f700 1 --2- 172.21.15.57:0/3157132078 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab410b910 0x7f1ab41a53a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1ab40f47c0 tx=0x7f1a9c00b9d0).stop 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.097 7f1abbb6f700 1 -- 172.21.15.57:0/3157132078 shutdown_connections 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.097 7f1abbb6f700 1 --2- 172.21.15.57:0/3157132078 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41a59d0 0x7f1ab41a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.097 7f1abbb6f700 1 --2- 172.21.15.57:0/3157132078 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab410b910 0x7f1ab41a53a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.097 7f1abbb6f700 1 -- 172.21.15.57:0/3157132078 >> 172.21.15.57:0/3157132078 conn(0x7f1ab4113a70 msgr2=0x7f1ab40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:55.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.097 7f1abbb6f700 1 -- 172.21.15.57:0/3157132078 shutdown_connections 2024-04-25T02:05:55.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.097 7f1abbb6f700 1 -- 172.21.15.57:0/3157132078 wait complete. 2024-04-25T02:05:55.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.121 7f1abbb6f700 1 Processor -- start 2024-04-25T02:05:55.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.121 7f1abbb6f700 1 -- start start 2024-04-25T02:05:55.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1abbb6f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ab41b3710 0x7f1ab41b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1abbb6f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41b4190 0x7f1ab41b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1abbb6f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab41b4c10 0x7f1ab41b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1abbb6f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40e0790 con 0x7f1ab41b3710 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1abbb6f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41b5690 con 0x7f1ab41b4190 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1abbb6f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40c21f0 con 0x7f1ab41b4c10 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab896a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ab41b3710 0x7f1ab41b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41b4190 0x7f1ab41b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab916b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab41b4c10 0x7f1ab41b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab896a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ab41b3710 0x7f1ab41b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57270/0 (socket says 172.21.15.57:57270) 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41b4190 0x7f1ab41b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49582/0 (socket says 172.21.15.57:49582) 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab896a700 1 -- 172.21.15.57:0/3217476250 learned_addr learned my addr 172.21.15.57:0/3217476250 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab916b700 1 -- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41b4190 msgr2=0x7f1ab41b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab916b700 1 --2- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41b4190 0x7f1ab41b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab916b700 1 -- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ab41b3710 msgr2=0x7f1ab41b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab916b700 1 --2- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ab41b3710 0x7f1ab41b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab916b700 1 -- 172.21.15.57:0/3217476250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40e0c90 con 0x7f1ab41b4c10 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab916b700 1 --2- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab41b4c10 0x7f1ab41b5060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1ab40ca770 tx=0x7f1aa400ec80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab1ffb700 1 -- 172.21.15.57:0/3217476250 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ab40e0c90 con 0x7f1ab41b4c10 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab1ffb700 1 -- 172.21.15.57:0/3217476250 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400c810 con 0x7f1ab41b4c10 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab41bbe40 con 0x7f1ab41b4c10 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.122 7f1ab1ffb700 1 -- 172.21.15.57:0/3217476250 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1aa400f040 con 0x7f1ab41b4c10 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.123 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab41bc220 con 0x7f1ab41b4c10 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.123 7f1ab1ffb700 1 -- 172.21.15.57:0/3217476250 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1aa4011070 con 0x7f1ab41b4c10 2024-04-25T02:05:55.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.123 7f1ab1ffb700 1 -- 172.21.15.57:0/3217476250 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1aa4010040 con 0x7f1ab41b4c10 2024-04-25T02:05:55.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.124 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab40f08e0 con 0x7f1ab41b4c10 2024-04-25T02:05:55.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.127 7f1ab1ffb700 1 -- 172.21.15.57:0/3217476250 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1aa400edc0 con 0x7f1ab41b4c10 2024-04-25T02:05:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.258 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1ab40cdf90 con 0x7f1ab41b4c10 2024-04-25T02:05:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.259 7f1ab1ffb700 1 -- 172.21.15.57:0/3217476250 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+32132 (secure 0 0 0) 0x7f1ab41145f0 con 0x7f1ab41b4c10 2024-04-25T02:05:55.265 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 >> v1:172.21.15.57:6816/43033 conn(0x7f1a980145b0 legacy=0x7f1a98016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab41b4c10 msgr2=0x7f1ab41b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 --2- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab41b4c10 0x7f1ab41b5060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1ab40ca770 tx=0x7f1aa400ec80).stop 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 shutdown_connections 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 --2- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ab41b4c10 0x7f1ab41b5060 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 --2- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ab41b3710 0x7f1ab41b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 --2- 172.21.15.57:0/3217476250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ab41b4190 0x7f1ab41b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 >> 172.21.15.57:0/3217476250 conn(0x7f1ab40bc620 msgr2=0x7f1ab40c0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 shutdown_connections 2024-04-25T02:05:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.261 7f1abbb6f700 1 -- 172.21.15.57:0/3217476250 wait complete. 2024-04-25T02:05:55.277 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6816","nonce":43033}]},"active_addr":"172.21.15.57:6816/43033","active_change":"2024-04-25 02:05:30.655410","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2024-04-25T02:05:55.278 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T02:05:55.278 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:05:55.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:55.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.403 7f5194b7b700 1 Processor -- start 2024-04-25T02:05:55.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.403 7f5194b7b700 1 -- start start 2024-04-25T02:05:55.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5194b7b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51900f5a10 0x7f519010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5194b7b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f519010b740 0x7f519019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5194b7b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51901a0a70 con 0x7f519010bb90 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5194b7b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51900fa590 con 0x7f51900f5a10 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5194b7b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51901a0c90 con 0x7f519010b740 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5187fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f519010b740 0x7f519019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f518e051700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f519010bb90 0x7f51901a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57582/0 (socket says 172.21.15.57:57582) 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f518d850700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51900f5a10 0x7f519010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5187fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f519010b740 0x7f519019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60700/0 (socket says 172.21.15.57:60700) 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f518e051700 1 -- 172.21.15.57:0/837182027 learned_addr learned my addr 172.21.15.57:0/837182027 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5187fff700 1 -- 172.21.15.57:0/837182027 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51900f5a10 msgr2=0x7f519010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5187fff700 1 --2- 172.21.15.57:0/837182027 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51900f5a10 0x7f519010b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5187fff700 1 -- 172.21.15.57:0/837182027 >> v1:172.21.15.57:6789/0 conn(0x7f519010bb90 legacy=0x7f51901a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f518d04f700 1 -- 172.21.15.57:0/837182027 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424550522 0 0) 0x7f5188001490 con 0x7f519010bb90 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f5187fff700 1 -- 172.21.15.57:0/837182027 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51901a93d0 con 0x7f519010b740 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.404 7f518d850700 1 --2- 172.21.15.57:0/837182027 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51900f5a10 0x7f519010b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5187fff700 1 --2- 172.21.15.57:0/837182027 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f519010b740 0x7f519019fc40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f519010f920 tx=0x7f517800b9d0).ready entity=mon.2 client_cookie=33bacd2f8b032f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f518d04f700 1 -- 172.21.15.57:0/837182027 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51901a93d0 con 0x7f519010b740 2024-04-25T02:05:55.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f518d04f700 1 -- 172.21.15.57:0/837182027 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517800d570 con 0x7f519010b740 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f518d04f700 1 -- 172.21.15.57:0/837182027 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f517800d940 con 0x7f519010b740 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5194b7b700 1 -- 172.21.15.57:0/837182027 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f519010b740 msgr2=0x7f519019fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5194b7b700 1 --2- 172.21.15.57:0/837182027 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f519010b740 0x7f519019fc40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f519010f920 tx=0x7f517800b9d0).stop 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5194b7b700 1 -- 172.21.15.57:0/837182027 shutdown_connections 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5194b7b700 1 --2- 172.21.15.57:0/837182027 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51900f5a10 0x7f519010b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5194b7b700 1 --2- 172.21.15.57:0/837182027 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f519010b740 0x7f519019fc40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5194b7b700 1 -- 172.21.15.57:0/837182027 >> 172.21.15.57:0/837182027 conn(0x7f5190113a70 msgr2=0x7f51900f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5194b7b700 1 -- 172.21.15.57:0/837182027 shutdown_connections 2024-04-25T02:05:55.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.405 7f5194b7b700 1 -- 172.21.15.57:0/837182027 wait complete. 2024-04-25T02:05:55.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.429 7f5194b7b700 1 Processor -- start 2024-04-25T02:05:55.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.429 7f5194b7b700 1 -- start start 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.429 7f5194b7b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900e07b0 0x7f51901b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.429 7f5194b7b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51901b1c80 0x7f51901b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5194b7b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f51901b20d0 0x7f51901b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5194b7b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51900c9c30 con 0x7f51900e07b0 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5194b7b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51900c8f60 con 0x7f51901b1c80 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5194b7b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51901b54f0 con 0x7f51901b20d0 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51901b1c80 0x7f51901b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f518d850700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900e07b0 0x7f51901b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51901b1c80 0x7f51901b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49594/0 (socket says 172.21.15.57:49594) 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 -- 172.21.15.57:0/4252898187 learned_addr learned my addr 172.21.15.57:0/4252898187 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f518d850700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900e07b0 0x7f51901b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57276/0 (socket says 172.21.15.57:57276) 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f518e051700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f51901b20d0 0x7f51901b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 -- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f51901b20d0 msgr2=0x7f51901b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f51901b20d0 0x7f51901b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 -- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900e07b0 msgr2=0x7f51901b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900e07b0 0x7f51901b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 -- 172.21.15.57:0/4252898187 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51901b56d0 con 0x7f51901b1c80 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f518d850700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900e07b0 0x7f51901b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5187fff700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51901b1c80 0x7f51901b4890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f51900e15f0 tx=0x7f51780068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5186ffd700 1 -- 172.21.15.57:0/4252898187 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51901b56d0 con 0x7f51901b1c80 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5186ffd700 1 -- 172.21.15.57:0/4252898187 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178011850 con 0x7f51901b1c80 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51901bbfa0 con 0x7f51901b1c80 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5186ffd700 1 -- 172.21.15.57:0/4252898187 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5178017040 con 0x7f51901b1c80 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.430 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51901bc380 con 0x7f51901b1c80 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.431 7f5186ffd700 1 -- 172.21.15.57:0/4252898187 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5178011c20 con 0x7f51901b1c80 2024-04-25T02:05:55.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.431 7f5186ffd700 1 -- 172.21.15.57:0/4252898187 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5178018070 con 0x7f51901b1c80 2024-04-25T02:05:55.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.432 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51901b58d0 con 0x7f51901b1c80 2024-04-25T02:05:55.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.435 7f5186ffd700 1 -- 172.21.15.57:0/4252898187 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f517800d360 con 0x7f51901b1c80 2024-04-25T02:05:55.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.545 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51900f08e0 con 0x7f51901b1c80 2024-04-25T02:05:55.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.545 7f5186ffd700 1 -- 172.21.15.57:0/4252898187 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7f5178011640 con 0x7f51901b1c80 2024-04-25T02:05:55.551 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:55.551 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:48.339447","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:55.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 >> v1:172.21.15.57:6816/43033 conn(0x7f51740145b0 legacy=0x7f5174016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51901b1c80 msgr2=0x7f51901b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51901b1c80 0x7f51901b4890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f51900e15f0 tx=0x7f51780068c0).stop 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 shutdown_connections 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f51901b20d0 0x7f51901b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900e07b0 0x7f51901b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 --2- 172.21.15.57:0/4252898187 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51901b1c80 0x7f51901b4890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 >> 172.21.15.57:0/4252898187 conn(0x7f51900db7a0 msgr2=0x7f51900c6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 shutdown_connections 2024-04-25T02:05:55.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.547 7f5194b7b700 1 -- 172.21.15.57:0/4252898187 wait complete. 2024-04-25T02:05:55.563 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:05:55.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:55.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.689 7f09b6844700 1 Processor -- start 2024-04-25T02:05:55.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.689 7f09b6844700 1 -- start start 2024-04-25T02:05:55.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.689 7f09b6844700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00f5920 0x7f09b010c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.689 7f09b6844700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b010cdc0 0x7f09b00f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.689 7f09b6844700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00f26c0 con 0x7f09b010c970 2024-04-25T02:05:55.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.689 7f09b6844700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00fa290 con 0x7f09b00f5920 2024-04-25T02:05:55.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.689 7f09b6844700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00f95c0 con 0x7f09b010cdc0 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09af5eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00f5920 0x7f09b010c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09afdec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b010cdc0 0x7f09b00f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09aedea700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f09b010c970 0x7f09b00f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57596/0 (socket says 172.21.15.57:57596) 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09af5eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00f5920 0x7f09b010c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49606/0 (socket says 172.21.15.57:49606) 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09aedea700 1 -- 172.21.15.57:0/2307649978 learned_addr learned my addr 172.21.15.57:0/2307649978 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09afdec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b010cdc0 0x7f09b00f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60728/0 (socket says 172.21.15.57:60728) 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09afdec700 1 -- 172.21.15.57:0/2307649978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00f5920 msgr2=0x7f09b010c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09ae5e9700 1 -- 172.21.15.57:0/2307649978 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68721129 0 0) 0x7f09a4001110 con 0x7f09b010c970 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09afdec700 1 --2- 172.21.15.57:0/2307649978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00f5920 0x7f09b010c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09afdec700 1 -- 172.21.15.57:0/2307649978 >> v1:172.21.15.57:6789/0 conn(0x7f09b010c970 legacy=0x7f09b00f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09afdec700 1 -- 172.21.15.57:0/2307649978 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b01aa5e0 con 0x7f09b010cdc0 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09af5eb700 1 --2- 172.21.15.57:0/2307649978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00f5920 0x7f09b010c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09afdec700 1 --2- 172.21.15.57:0/2307649978 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b010cdc0 0x7f09b00f2090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f09b0113400 tx=0x7f09a8009cf0).ready entity=mon.2 client_cookie=4f342151921fade6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09ae5e9700 1 -- 172.21.15.57:0/2307649978 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09b01aa5e0 con 0x7f09b010cdc0 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09ae5e9700 1 -- 172.21.15.57:0/2307649978 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800b840 con 0x7f09b010cdc0 2024-04-25T02:05:55.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09ae5e9700 1 -- 172.21.15.57:0/2307649978 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09a800ba20 con 0x7f09b010cdc0 2024-04-25T02:05:55.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09b6844700 1 -- 172.21.15.57:0/2307649978 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b010cdc0 msgr2=0x7f09b00f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.690 7f09b6844700 1 --2- 172.21.15.57:0/2307649978 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b010cdc0 0x7f09b00f2090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f09b0113400 tx=0x7f09a8009cf0).stop 2024-04-25T02:05:55.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.691 7f09b6844700 1 -- 172.21.15.57:0/2307649978 shutdown_connections 2024-04-25T02:05:55.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.691 7f09b6844700 1 --2- 172.21.15.57:0/2307649978 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b010cdc0 0x7f09b00f2090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.691 7f09b6844700 1 --2- 172.21.15.57:0/2307649978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00f5920 0x7f09b010c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.691 7f09b6844700 1 -- 172.21.15.57:0/2307649978 >> 172.21.15.57:0/2307649978 conn(0x7f09b0113a70 msgr2=0x7f09b00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:55.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.691 7f09b6844700 1 -- 172.21.15.57:0/2307649978 shutdown_connections 2024-04-25T02:05:55.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.691 7f09b6844700 1 -- 172.21.15.57:0/2307649978 wait complete. 2024-04-25T02:05:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.715 7f09b6844700 1 Processor -- start 2024-04-25T02:05:55.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.715 7f09b6844700 1 -- start start 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.715 7f09b6844700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b00dbf70 0x7f09b00d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.715 7f09b6844700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00d34d0 0x7f09b01b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.715 7f09b6844700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00d3920 0x7f09b01b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.715 7f09b6844700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00f0250 con 0x7f09b00d34d0 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.715 7f09b6844700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00db5f0 con 0x7f09b00d3920 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.715 7f09b6844700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00db940 con 0x7f09b00dbf70 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00d34d0 0x7f09b01b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09afdec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00d3920 0x7f09b01b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09af5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b00dbf70 0x7f09b00d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00d34d0 0x7f09b01b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57282/0 (socket says 172.21.15.57:57282) 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09af5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b00dbf70 0x7f09b00d2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60736/0 (socket says 172.21.15.57:60736) 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09afdec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00d3920 0x7f09b01b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49620/0 (socket says 172.21.15.57:49620) 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 -- 172.21.15.57:0/3497908760 learned_addr learned my addr 172.21.15.57:0/3497908760 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:55.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 -- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b00dbf70 msgr2=0x7f09b00d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 --2- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b00dbf70 0x7f09b00d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 -- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00d3920 msgr2=0x7f09b01b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 --2- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00d3920 0x7f09b01b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 -- 172.21.15.57:0/3497908760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b01b10c0 con 0x7f09b00d34d0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09afdec700 1 --2- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00d3920 0x7f09b01b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09aedea700 1 --2- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00d34d0 0x7f09b01b0460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f09b00dbbc0 tx=0x7f09a400c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09acde6700 1 -- 172.21.15.57:0/3497908760 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09b01b10c0 con 0x7f09b00d34d0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09acde6700 1 -- 172.21.15.57:0/3497908760 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a400ce00 con 0x7f09b00d34d0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09acde6700 1 -- 172.21.15.57:0/3497908760 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f09a4005620 con 0x7f09b00d34d0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09b6844700 1 -- 172.21.15.57:0/3497908760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b01b13e0 con 0x7f09b00d34d0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.716 7f09b6844700 1 -- 172.21.15.57:0/3497908760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b01b7db0 con 0x7f09b00d34d0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.717 7f09acde6700 1 -- 172.21.15.57:0/3497908760 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f09a4005820 con 0x7f09b00d34d0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.717 7f09acde6700 1 -- 172.21.15.57:0/3497908760 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f09a4014800 con 0x7f09b00d34d0 2024-04-25T02:05:55.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.717 7f09b6844700 1 -- 172.21.15.57:0/3497908760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b00f08e0 con 0x7f09b00d34d0 2024-04-25T02:05:55.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.721 7f09acde6700 1 -- 172.21.15.57:0/3497908760 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f09a40070d0 con 0x7f09b00d34d0 2024-04-25T02:05:55.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.832 7f09b6844700 1 -- 172.21.15.57:0/3497908760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09b00db220 con 0x7f09b00d34d0 2024-04-25T02:05:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.832 7f09acde6700 1 -- 172.21.15.57:0/3497908760 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7f09a4000c30 con 0x7f09b00d34d0 2024-04-25T02:05:55.838 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:55.838 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:48.339447","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 -- 172.21.15.57:0/3497908760 >> v1:172.21.15.57:6816/43033 conn(0x7f09900145b0 legacy=0x7f0990016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 -- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00d34d0 msgr2=0x7f09b01b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 --2- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00d34d0 0x7f09b01b0460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f09b00dbbc0 tx=0x7f09a400c890).stop 2024-04-25T02:05:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 -- 172.21.15.57:0/3497908760 shutdown_connections 2024-04-25T02:05:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 --2- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09b00d3920 0x7f09b01b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 --2- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09b00dbf70 0x7f09b00d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 --2- 172.21.15.57:0/3497908760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09b00d34d0 0x7f09b01b0460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 -- 172.21.15.57:0/3497908760 >> 172.21.15.57:0/3497908760 conn(0x7f09b00c37f0 msgr2=0x7f09b00c1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 -- 172.21.15.57:0/3497908760 shutdown_connections 2024-04-25T02:05:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.834 7f09b6844700 1 -- 172.21.15.57:0/3497908760 wait complete. 2024-04-25T02:05:55.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T02:05:55.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T02:05:55.852 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T02:05:55.852 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T02:05:55.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7f7e3199d700 1 Processor -- start 2024-04-25T02:05:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7fa333011700 1 Processor -- start 2024-04-25T02:05:55.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7fa333011700 1 -- start start 2024-04-25T02:05:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7f7e3199d700 1 -- start start 2024-04-25T02:05:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7f7e3199d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0f5a00 0x7f7e2c1a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7f7e3199d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e2c1a14b0 0x7f7e2c0f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7f7e3199d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0f1eb0 0x7f7e2c1ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7f7e3199d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0fa330 con 0x7f7e2c1a14b0 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7f7e3199d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0f9660 con 0x7f7e2c0f1eb0 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.987 7f7e3199d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0f2300 con 0x7f7e2c0f5a00 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0f5a00 0x7f7e2c1a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0f5a00 0x7f7e2c1a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60750/0 (socket says 172.21.15.57:60750) 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 -- 172.21.15.57:0/4281251540 learned_addr learned my addr 172.21.15.57:0/4281251540 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 -- 172.21.15.57:0/4281251540 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0f1eb0 msgr2=0x7f7e2c1ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 --2- 172.21.15.57:0/4281251540 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0f1eb0 0x7f7e2c1ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 -- 172.21.15.57:0/4281251540 >> v2:172.21.15.57:3300/0 conn(0x7f7e2c1a14b0 msgr2=0x7f7e2c0f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 --2- 172.21.15.57:0/4281251540 >> v2:172.21.15.57:3300/0 conn(0x7f7e2c1a14b0 0x7f7e2c0f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 -- 172.21.15.57:0/4281251540 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0f2530 con 0x7f7e2c0f5a00 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e2a5c5700 1 --2- 172.21.15.57:0/4281251540 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0f5a00 0x7f7e2c1a0e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7e2c114520 tx=0x7f7e1c009a30).ready entity=mon.2 client_cookie=49b6fbe671cd1657 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e295c3700 1 -- 172.21.15.57:0/4281251540 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e2c0f2530 con 0x7f7e2c0f5a00 2024-04-25T02:05:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e295c3700 1 -- 172.21.15.57:0/4281251540 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00f510 con 0x7f7e2c0f5a00 2024-04-25T02:05:55.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7fa333011700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa32c0f5a00 0x7fa32c10b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7fa333011700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c10b730 0x7fa32c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:55.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7f7e295c3700 1 -- 172.21.15.57:0/4281251540 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e1c00f6f0 con 0x7f7e2c0f5a00 2024-04-25T02:05:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7fa333011700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c1a0a60 con 0x7fa32c10bb80 2024-04-25T02:05:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7fa333011700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c0fa580 con 0x7fa32c0f5a00 2024-04-25T02:05:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7fa32affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c10b730 0x7fa32c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7fa32affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c10b730 0x7fa32c19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60760/0 (socket says 172.21.15.57:60760) 2024-04-25T02:05:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7fa32affd700 1 -- 172.21.15.57:0/3485405319 learned_addr learned my addr 172.21.15.57:0/3485405319 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.988 7fa333011700 1 -- 172.21.15.57:0/3485405319 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1a0c80 con 0x7fa32c10b730 2024-04-25T02:05:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7f7e3199d700 1 -- 172.21.15.57:0/4281251540 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0f5a00 msgr2=0x7f7e2c1a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7f7e3199d700 1 --2- 172.21.15.57:0/4281251540 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0f5a00 0x7f7e2c1a0e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7e2c114520 tx=0x7f7e1c009a30).stop 2024-04-25T02:05:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa32affd700 1 -- 172.21.15.57:0/3485405319 >> v2:172.21.15.57:3300/0 conn(0x7fa32c0f5a00 msgr2=0x7fa32c10b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa32affd700 1 --2- 172.21.15.57:0/3485405319 >> v2:172.21.15.57:3300/0 conn(0x7fa32c0f5a00 0x7fa32c10b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa32affd700 1 -- 172.21.15.57:0/3485405319 >> v1:172.21.15.57:6789/0 conn(0x7fa32c10bb80 legacy=0x7fa32c1a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa32affd700 1 -- 172.21.15.57:0/3485405319 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c1a5390 con 0x7fa32c10b730 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa32affd700 1 --2- 172.21.15.57:0/3485405319 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c10b730 0x7fa32c19fc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa32c103a00 tx=0x7fa31c009a00).ready entity=mon.2 client_cookie=fdc390a1ed8e8b43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa32a7fc700 1 -- 172.21.15.57:0/3485405319 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa32c1a5390 con 0x7fa32c10b730 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa32a7fc700 1 -- 172.21.15.57:0/3485405319 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c00f510 con 0x7fa32c10b730 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa32a7fc700 1 -- 172.21.15.57:0/3485405319 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa31c00f6f0 con 0x7fa32c10b730 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa333011700 1 -- 172.21.15.57:0/3485405319 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c10b730 msgr2=0x7fa32c19fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.989 7fa333011700 1 --2- 172.21.15.57:0/3485405319 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c10b730 0x7fa32c19fc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa32c103a00 tx=0x7fa31c009a00).stop 2024-04-25T02:05:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7f7e3199d700 1 -- 172.21.15.57:0/4281251540 shutdown_connections 2024-04-25T02:05:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7f7e3199d700 1 --2- 172.21.15.57:0/4281251540 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0f1eb0 0x7f7e2c1ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7f7e3199d700 1 --2- 172.21.15.57:0/4281251540 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0f5a00 0x7f7e2c1a0e80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7f7e3199d700 1 --2- 172.21.15.57:0/4281251540 >> v2:172.21.15.57:3300/0 conn(0x7f7e2c1a14b0 0x7f7e2c0f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7f7e3199d700 1 -- 172.21.15.57:0/4281251540 >> 172.21.15.57:0/4281251540 conn(0x7f7e2c113a60 msgr2=0x7f7e2c0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7f7e3199d700 1 -- 172.21.15.57:0/4281251540 shutdown_connections 2024-04-25T02:05:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7f7e3199d700 1 -- 172.21.15.57:0/4281251540 wait complete. 2024-04-25T02:05:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7fa333011700 1 -- 172.21.15.57:0/3485405319 shutdown_connections 2024-04-25T02:05:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7fa333011700 1 --2- 172.21.15.57:0/3485405319 >> v2:172.21.15.57:3300/0 conn(0x7fa32c0f5a00 0x7fa32c10b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7fa333011700 1 --2- 172.21.15.57:0/3485405319 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c10b730 0x7fa32c19fc30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7fa333011700 1 -- 172.21.15.57:0/3485405319 >> 172.21.15.57:0/3485405319 conn(0x7fa32c113a60 msgr2=0x7fa32c0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7fa333011700 1 -- 172.21.15.57:0/3485405319 shutdown_connections 2024-04-25T02:05:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:55.990 7fa333011700 1 -- 172.21.15.57:0/3485405319 wait complete. 2024-04-25T02:05:56.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.014 7f7e3199d700 1 Processor -- start 2024-04-25T02:05:56.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.014 7f7e3199d700 1 -- start start 2024-04-25T02:05:56.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.014 7f7e3199d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e2c0d1800 0x7f7e2c0df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.014 7f7e3199d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0b46b0 0x7f7e2c0df990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.014 7f7e3199d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0dffc0 0x7f7e2c1c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.014 7f7e3199d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0f5dd0 con 0x7f7e2c0d1800 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.014 7f7e3199d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b4e70 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.014 7f7e3199d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0e0900 con 0x7f7e2c0dffc0 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0b46b0 0x7f7e2c0df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0b46b0 0x7f7e2c0df990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49640/0 (socket says 172.21.15.57:49640) 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 -- 172.21.15.57:0/4178149236 learned_addr learned my addr 172.21.15.57:0/4178149236 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e2adc6700 1 --2- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0dffc0 0x7f7e2c1c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e2a5c5700 1 --2- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e2c0d1800 0x7f7e2c0df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 -- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0dffc0 msgr2=0x7f7e2c1c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 --2- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0dffc0 0x7f7e2c1c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 -- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e2c0d1800 msgr2=0x7f7e2c0df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 --2- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e2c0d1800 0x7f7e2c0df360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 -- 172.21.15.57:0/4178149236 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0b5130 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e2a5c5700 1 --2- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e2c0d1800 0x7f7e2c0df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:05:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e2adc6700 1 --2- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e2c0dffc0 0x7f7e2c1c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e29dc4700 1 --2- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0b46b0 0x7f7e2c0df990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7e2c0cb6f0 tx=0x7f7e20009890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e2c0b5130 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e20013460 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7e20013830 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.015 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c1c84c0 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.016 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c1c88a0 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.017 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7e20013a30 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.017 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7e20008d90 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.017 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e2c087740 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.017 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 --> v1:172.21.15.57:6808/43632 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e0801ed70 con 0x7f7e0801af60 2024-04-25T02:05:56.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.017 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e20011c90 con 0x7f7e2c0b46b0 2024-04-25T02:05:56.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.018 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 <== osd.3 v1:172.21.15.57:6808/43632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f7e0801ed70 con 0x7f7e0801af60 2024-04-25T02:05:56.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.019 7fa333011700 1 Processor -- start 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.019 7fa333011700 1 -- start start 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa333011700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0cc920 0x7fa32c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa333011700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa32c1b42f0 0x7fa32c1b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa333011700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c1b4d70 0x7fa32c1bb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa333011700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1b51c0 con 0x7fa32c0cc920 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa333011700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c3d70 con 0x7fa32c1b42f0 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa333011700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c3fa0 con 0x7fa32c1b4d70 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0cc920 0x7fa32c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0cc920 0x7fa32c0ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57320/0 (socket says 172.21.15.57:57320) 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c1b4d70 0x7fa32c1bb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32b7fe700 1 -- 172.21.15.57:0/4291606464 learned_addr learned my addr 172.21.15.57:0/4291606464 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32affd700 1 --2- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa32c1b42f0 0x7fa32c1b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32affd700 1 -- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c1b4d70 msgr2=0x7fa32c1bb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32affd700 1 --2- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c1b4d70 0x7fa32c1bb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32affd700 1 -- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0cc920 msgr2=0x7fa32c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32affd700 1 --2- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0cc920 0x7fa32c0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32affd700 1 -- 172.21.15.57:0/4291606464 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0d5f00 con 0x7fa32c1b42f0 2024-04-25T02:05:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.020 7fa32bfff700 1 --2- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa32c1b4d70 0x7fa32c1bb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.021 7fa32affd700 1 --2- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa32c1b42f0 0x7fa32c1b4740 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa32c0e6870 tx=0x7fa31c0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.021 7fa328ff9700 1 -- 172.21.15.57:0/4291606464 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa32c0d5f00 con 0x7fa32c1b42f0 2024-04-25T02:05:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.021 7fa328ff9700 1 -- 172.21.15.57:0/4291606464 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c0119c0 con 0x7fa32c1b42f0 2024-04-25T02:05:56.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.021 7fa333011700 1 -- 172.21.15.57:0/4291606464 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c1bbe00 con 0x7fa32c1b42f0 2024-04-25T02:05:56.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.021 7fa328ff9700 1 -- 172.21.15.57:0/4291606464 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa31c021070 con 0x7fa32c1b42f0 2024-04-25T02:05:56.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.021 7fa333011700 1 -- 172.21.15.57:0/4291606464 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c1bc000 con 0x7fa32c1b42f0 2024-04-25T02:05:56.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.021 7fa328ff9700 1 -- 172.21.15.57:0/4291606464 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa31c019030 con 0x7fa32c1b42f0 2024-04-25T02:05:56.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.021 7fa328ff9700 1 -- 172.21.15.57:0/4291606464 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa31c018040 con 0x7fa32c1b42f0 2024-04-25T02:05:56.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.022 7fa333011700 1 -- 172.21.15.57:0/4291606464 --> v1:172.21.15.57:6804/43629 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa32c087740 con 0x7fa32c0a7740 2024-04-25T02:05:56.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.022 7fa328ff9700 1 -- 172.21.15.57:0/4291606464 <== osd.1 v1:172.21.15.57:6804/43629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fa324009980 con 0x7fa32c0a7740 2024-04-25T02:05:56.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.029 7f8c2758e700 1 Processor -- start 2024-04-25T02:05:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.029 7fa333011700 1 -- 172.21.15.57:0/4291606464 --> v1:172.21.15.57:6804/43629 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa32c0ba2c0 con 0x7fa32c0a7740 2024-04-25T02:05:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.029 7f8c2758e700 1 -- start start 2024-04-25T02:05:56.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.029 7fa328ff9700 1 -- 172.21.15.57:0/4291606464 <== osd.1 v1:172.21.15.57:6804/43629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2652970471) 0x7fa32c0ba2c0 con 0x7fa32c0a7740 2024-04-25T02:05:56.035 INFO:teuthology.orchestra.run.smithi057.stdout:38654705671 2024-04-25T02:05:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.029 7f8c2758e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8c200f5a00 0x7f8c2010b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f8c2758e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c2010b730 0x7f8c2019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f8c2758e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c201a0a60 con 0x7f8c2010bb80 2024-04-25T02:05:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f8c2758e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c200fa580 con 0x7f8c200f5a00 2024-04-25T02:05:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f8c2758e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c201a0c80 con 0x7f8c2010b730 2024-04-25T02:05:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa333011700 1 -- 172.21.15.57:0/4291606464 >> v1:172.21.15.57:6804/43629 conn(0x7fa32c0a7740 legacy=0x7fa32c0a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 --> v1:172.21.15.57:6808/43632 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e2c0f08d0 con 0x7f7e0801af60 2024-04-25T02:05:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa333011700 1 -- 172.21.15.57:0/4291606464 >> v1:172.21.15.57:6816/43033 conn(0x7fa30c0145b0 legacy=0x7fa30c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa333011700 1 -- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa32c1b42f0 msgr2=0x7fa32c1b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa333011700 1 --2- 172.21.15.57:0/4291606464 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa32c1b42f0 0x7fa32c1b4740 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa32c0e6870 tx=0x7fa31c0068c0).stop 2024-04-25T02:05:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa32bfff700 1 -- 172.21.15.57:0/4291606464 reap_dead start 2024-04-25T02:05:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa333011700 1 -- 172.21.15.57:0/4291606464 shutdown_connections 2024-04-25T02:05:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa333011700 1 -- 172.21.15.57:0/4291606464 >> 172.21.15.57:0/4291606464 conn(0x7fa32c0da3b0 msgr2=0x7fa32c0e0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa333011700 1 -- 172.21.15.57:0/4291606464 shutdown_connections 2024-04-25T02:05:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f8c1f7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c2010b730 0x7f8c2019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f8c1f7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c2010b730 0x7f8c2019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60784/0 (socket says 172.21.15.57:60784) 2024-04-25T02:05:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f8c1f7fe700 1 -- 172.21.15.57:0/2148018105 learned_addr learned my addr 172.21.15.57:0/2148018105 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7fa333011700 1 -- 172.21.15.57:0/4291606464 wait complete. 2024-04-25T02:05:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.030 7f8c1ffff700 1 --2- 172.21.15.57:0/2148018105 >> v2:172.21.15.57:3300/0 conn(0x7f8c200f5a00 0x7f8c2010b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1f7fe700 1 -- 172.21.15.57:0/2148018105 >> v2:172.21.15.57:3300/0 conn(0x7f8c200f5a00 msgr2=0x7f8c2010b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1f7fe700 1 --2- 172.21.15.57:0/2148018105 >> v2:172.21.15.57:3300/0 conn(0x7f8c200f5a00 0x7f8c2010b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1effd700 1 -- 172.21.15.57:0/2148018105 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142514779 0 0) 0x7f8c18001490 con 0x7f8c2010bb80 2024-04-25T02:05:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1f7fe700 1 -- 172.21.15.57:0/2148018105 >> v1:172.21.15.57:6789/0 conn(0x7f8c2010bb80 legacy=0x7f8c201a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1f7fe700 1 -- 172.21.15.57:0/2148018105 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c201a93c0 con 0x7f8c2010b730 2024-04-25T02:05:56.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f7e1b7fe700 1 -- 172.21.15.57:0/4178149236 <== osd.3 v1:172.21.15.57:6808/43632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7f7e2c0f08d0 con 0x7f7e0801af60 2024-04-25T02:05:56.041 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-25T02:05:56.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1f7fe700 1 --2- 172.21.15.57:0/2148018105 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c2010b730 0x7f8c2019fc30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8c20103a00 tx=0x7f8c14009a00).ready entity=mon.2 client_cookie=a3d60945629fb230 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1effd700 1 -- 172.21.15.57:0/2148018105 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c201a93c0 con 0x7f8c2010b730 2024-04-25T02:05:56.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1effd700 1 -- 172.21.15.57:0/2148018105 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400f510 con 0x7f8c2010b730 2024-04-25T02:05:56.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c1effd700 1 -- 172.21.15.57:0/2148018105 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c1400f6f0 con 0x7f8c2010b730 2024-04-25T02:05:56.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c2758e700 1 -- 172.21.15.57:0/2148018105 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c2010b730 msgr2=0x7f8c2019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.031 7f8c2758e700 1 --2- 172.21.15.57:0/2148018105 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c2010b730 0x7f8c2019fc30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8c20103a00 tx=0x7f8c14009a00).stop 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 >> v1:172.21.15.57:6808/43632 conn(0x7f7e0801af60 legacy=0x7f7e0801d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 >> v1:172.21.15.57:6816/43033 conn(0x7f7e080145b0 legacy=0x7f7e08016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0b46b0 msgr2=0x7f7e2c0df990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e3199d700 1 --2- 172.21.15.57:0/4178149236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e2c0b46b0 0x7f7e2c0df990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7e2c0cb6f0 tx=0x7f7e20009890).stop 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e2adc6700 1 -- 172.21.15.57:0/4178149236 reap_dead start 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 shutdown_connections 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 >> 172.21.15.57:0/4178149236 conn(0x7f7e2c0d5cf0 msgr2=0x7f7e2c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 shutdown_connections 2024-04-25T02:05:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f7e3199d700 1 -- 172.21.15.57:0/4178149236 wait complete. 2024-04-25T02:05:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f8c2758e700 1 -- 172.21.15.57:0/2148018105 shutdown_connections 2024-04-25T02:05:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f8c2758e700 1 --2- 172.21.15.57:0/2148018105 >> v2:172.21.15.57:3300/0 conn(0x7f8c200f5a00 0x7f8c2010b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f8c2758e700 1 --2- 172.21.15.57:0/2148018105 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c2010b730 0x7f8c2019fc30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f8c2758e700 1 -- 172.21.15.57:0/2148018105 >> 172.21.15.57:0/2148018105 conn(0x7f8c20113a60 msgr2=0x7f8c200f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f8c2758e700 1 -- 172.21.15.57:0/2148018105 shutdown_connections 2024-04-25T02:05:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.032 7f8c2758e700 1 -- 172.21.15.57:0/2148018105 wait complete. 2024-04-25T02:05:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.040 7f33b61c1700 1 Processor -- start 2024-04-25T02:05:56.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.040 7f33b61c1700 1 -- start start 2024-04-25T02:05:56.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.040 7f33b61c1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00f90f0 0x7f33b01a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.040 7f33b61c1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01a51d0 0x7f33b01a7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.040 7f33b61c1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b00f9540 con 0x7f33b00f5480 2024-04-25T02:05:56.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.040 7f33b61c1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0104dc0 con 0x7f33b01a51d0 2024-04-25T02:05:56.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33b61c1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0104ff0 con 0x7f33b00f90f0 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33ae5c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00f90f0 0x7f33b01a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33af5c7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01a51d0 0x7f33b01a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33ae5c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00f90f0 0x7f33b01a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60786/0 (socket says 172.21.15.57:60786) 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33ae5c5700 1 -- 172.21.15.57:0/2481839456 learned_addr learned my addr 172.21.15.57:0/2481839456 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33af5c7700 1 -- 172.21.15.57:0/2481839456 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00f90f0 msgr2=0x7f33b01a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33af5c7700 1 --2- 172.21.15.57:0/2481839456 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00f90f0 0x7f33b01a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33af5c7700 1 -- 172.21.15.57:0/2481839456 >> v1:172.21.15.57:6789/0 conn(0x7f33b00f5480 legacy=0x7f33b00f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33af5c7700 1 -- 172.21.15.57:0/2481839456 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b01a8c70 con 0x7f33b01a51d0 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33ae5c5700 1 --2- 172.21.15.57:0/2481839456 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00f90f0 0x7f33b01a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.041 7f33af5c7700 1 --2- 172.21.15.57:0/2481839456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01a51d0 0x7f33b01a7630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f33b00ab6f0 tx=0x7f33a800ae10).ready entity=mon.1 client_cookie=5418a0be69614f6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33addc4700 1 -- 172.21.15.57:0/2481839456 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33b01a8c70 con 0x7f33b01a51d0 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33addc4700 1 -- 172.21.15.57:0/2481839456 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800b970 con 0x7f33b01a51d0 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33addc4700 1 -- 172.21.15.57:0/2481839456 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33a8014070 con 0x7f33b01a51d0 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33b61c1700 1 -- 172.21.15.57:0/2481839456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01a51d0 msgr2=0x7f33b01a7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33b61c1700 1 --2- 172.21.15.57:0/2481839456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01a51d0 0x7f33b01a7630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f33b00ab6f0 tx=0x7f33a800ae10).stop 2024-04-25T02:05:56.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33b61c1700 1 -- 172.21.15.57:0/2481839456 shutdown_connections 2024-04-25T02:05:56.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33b61c1700 1 --2- 172.21.15.57:0/2481839456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01a51d0 0x7f33b01a7630 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33b61c1700 1 --2- 172.21.15.57:0/2481839456 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00f90f0 0x7f33b01a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.042 7f33b61c1700 1 -- 172.21.15.57:0/2481839456 >> 172.21.15.57:0/2481839456 conn(0x7f33b0113570 msgr2=0x7f33b00f4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.043 7f33b61c1700 1 -- 172.21.15.57:0/2481839456 shutdown_connections 2024-04-25T02:05:56.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.043 7f33b61c1700 1 -- 172.21.15.57:0/2481839456 wait complete. 2024-04-25T02:05:56.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:05:56.053 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:05:56.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.059 7f8c2758e700 1 Processor -- start 2024-04-25T02:05:56.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.059 7f8c2758e700 1 -- start start 2024-04-25T02:05:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c2758e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c200c7e10 0x7f8c200d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c2758e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c200d5800 0x7f8c201b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c2758e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c200d5c50 0x7f8c201b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c2758e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200ccda0 con 0x7f8c200d5c50 2024-04-25T02:05:56.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c2758e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c200cd910 con 0x7f8c200d5800 2024-04-25T02:05:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c2758e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c201b2ee0 con 0x7f8c200c7e10 2024-04-25T02:05:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c1ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c200c7e10 0x7f8c200d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c1ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c200c7e10 0x7f8c200d51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60798/0 (socket says 172.21.15.57:60798) 2024-04-25T02:05:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c1ffff700 1 -- 172.21.15.57:0/3765046705 learned_addr learned my addr 172.21.15.57:0/3765046705 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c1f7fe700 1 --2- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c200d5800 0x7f8c201b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.060 7f8c24b8a700 1 --2- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c200d5c50 0x7f8c201b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1ffff700 1 -- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c200d5800 msgr2=0x7f8c201b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1ffff700 1 --2- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c200d5800 0x7f8c201b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1ffff700 1 -- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c200d5c50 msgr2=0x7f8c201b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1ffff700 1 --2- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c200d5c50 0x7f8c201b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1ffff700 1 -- 172.21.15.57:0/3765046705 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c201b30c0 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c24b8a700 1 --2- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c200d5c50 0x7f8c201b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1ffff700 1 --2- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c200c7e10 0x7f8c200d51d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8c1000c000 tx=0x7f8c1000ec20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c201b30c0 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c201b99f0 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000ca20 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8c1000f040 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.061 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c201b9dd0 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.062 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8c10011070 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.062 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c20087740 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.062 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8c10010040 con 0x7f8c200c7e10 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.063 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 --> v1:172.21.15.57:6812/43631 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c0001ed60 con 0x7f8c0001af50 2024-04-25T02:05:56.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.063 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c1001a9b0 con 0x7f8c200c7e10 2024-04-25T02:05:56.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.064 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 <== osd.0 v1:172.21.15.57:6812/43631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f8c0001ed60 con 0x7f8c0001af50 2024-04-25T02:05:56.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33b61c1700 1 Processor -- start 2024-04-25T02:05:56.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33b61c1700 1 -- start start 2024-04-25T02:05:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33b61c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b00ca3b0 0x7f33b00ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33b61c1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00cae30 0x7f33b01b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33b61c1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01b0820 0x7f33b01b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33b61c1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00c4330 con 0x7f33b00ca3b0 2024-04-25T02:05:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33b61c1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00de880 con 0x7f33b01b0820 2024-04-25T02:05:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33b61c1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00deb40 con 0x7f33b00cae30 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33aedc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b00ca3b0 0x7f33b00ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33aedc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b00ca3b0 0x7f33b00ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57346/0 (socket says 172.21.15.57:57346) 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33aedc6700 1 -- 172.21.15.57:0/1746336496 learned_addr learned my addr 172.21.15.57:0/1746336496 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.070 7f33ae5c5700 1 --2- 172.21.15.57:0/1746336496 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00cae30 0x7f33b01b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f33aedc6700 1 -- 172.21.15.57:0/1746336496 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00cae30 msgr2=0x7f33b01b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f33aedc6700 1 --2- 172.21.15.57:0/1746336496 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b00cae30 0x7f33b01b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f33aedc6700 1 -- 172.21.15.57:0/1746336496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01b0820 msgr2=0x7f33b01b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f33aedc6700 1 --2- 172.21.15.57:0/1746336496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b01b0820 0x7f33b01b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f33aedc6700 1 -- 172.21.15.57:0/1746336496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b00df140 con 0x7f33b00ca3b0 2024-04-25T02:05:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f33aedc6700 1 --2- 172.21.15.57:0/1746336496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b00ca3b0 0x7f33b00ca800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f33a0000ed0 tx=0x7f33a000c7b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f339ffff700 1 -- 172.21.15.57:0/1746336496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33b00df140 con 0x7f33b00ca3b0 2024-04-25T02:05:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f339ffff700 1 -- 172.21.15.57:0/1746336496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0011960 con 0x7f33b00ca3b0 2024-04-25T02:05:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b01b78e0 con 0x7f33b00ca3b0 2024-04-25T02:05:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f339ffff700 1 -- 172.21.15.57:0/1746336496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33a0011d30 con 0x7f33b00ca3b0 2024-04-25T02:05:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.071 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b01b7cc0 con 0x7f33b00ca3b0 2024-04-25T02:05:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.072 7f339ffff700 1 -- 172.21.15.57:0/1746336496 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f33a00193d0 con 0x7f33b00ca3b0 2024-04-25T02:05:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.072 7f339ffff700 1 -- 172.21.15.57:0/1746336496 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f33a001bcc0 con 0x7f33b00ca3b0 2024-04-25T02:05:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.072 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33b0087740 con 0x7f33b00ca3b0 2024-04-25T02:05:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.072 7f339ffff700 1 -- 172.21.15.57:0/1746336496 --> v1:172.21.15.57:6800/43633 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f338c01ed70 con 0x7f338c01af60 2024-04-25T02:05:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.072 7f339ffff700 1 -- 172.21.15.57:0/1746336496 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33a0015bb0 con 0x7f33b00ca3b0 2024-04-25T02:05:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.073 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 --> v1:172.21.15.57:6812/43631 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c200f08d0 con 0x7f8c0001af50 2024-04-25T02:05:56.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.073 7f8c1d7fa700 1 -- 172.21.15.57:0/3765046705 <== osd.0 v1:172.21.15.57:6812/43631 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2652970471) 0x7f8c200f08d0 con 0x7f8c0001af50 2024-04-25T02:05:56.080 INFO:teuthology.orchestra.run.smithi057.stdout:38654705671 2024-04-25T02:05:56.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.073 7f339ffff700 1 -- 172.21.15.57:0/1746336496 <== osd.2 v1:172.21.15.57:6800/43633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f338c01ed70 con 0x7f338c01af60 2024-04-25T02:05:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.074 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 >> v1:172.21.15.57:6812/43631 conn(0x7f8c0001af50 legacy=0x7f8c0001d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.074 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 >> v1:172.21.15.57:6816/43033 conn(0x7f8c000145b0 legacy=0x7f8c00016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.074 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c200c7e10 msgr2=0x7f8c200d51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.074 7f8c2758e700 1 --2- 172.21.15.57:0/3765046705 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8c200c7e10 0x7f8c200d51d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8c1000c000 tx=0x7f8c1000ec20).stop 2024-04-25T02:05:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.074 7f8c24b8a700 1 -- 172.21.15.57:0/3765046705 reap_dead start 2024-04-25T02:05:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.074 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 shutdown_connections 2024-04-25T02:05:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.074 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 >> 172.21.15.57:0/3765046705 conn(0x7f8c200c4700 msgr2=0x7f8c200dfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.075 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 shutdown_connections 2024-04-25T02:05:56.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.075 7f8c2758e700 1 -- 172.21.15.57:0/3765046705 wait complete. 2024-04-25T02:05:56.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.084 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 --> v1:172.21.15.57:6800/43633 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33b00f08d0 con 0x7f338c01af60 2024-04-25T02:05:56.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.085 7f339ffff700 1 -- 172.21.15.57:0/1746336496 <== osd.2 v1:172.21.15.57:6800/43633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2652970471) 0x7f33b00f08d0 con 0x7f338c01af60 2024-04-25T02:05:56.090 INFO:teuthology.orchestra.run.smithi057.stdout:38654705671 2024-04-25T02:05:56.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.085 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 >> v1:172.21.15.57:6800/43633 conn(0x7f338c01af60 legacy=0x7f338c01d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.085 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 >> v1:172.21.15.57:6816/43033 conn(0x7f338c0145b0 legacy=0x7f338c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.085 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b00ca3b0 msgr2=0x7f33b00ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.085 7f33b61c1700 1 --2- 172.21.15.57:0/1746336496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b00ca3b0 0x7f33b00ca800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f33a0000ed0 tx=0x7f33a000c7b0).stop 2024-04-25T02:05:56.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.085 7f33af5c7700 1 -- 172.21.15.57:0/1746336496 reap_dead start 2024-04-25T02:05:56.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.086 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 shutdown_connections 2024-04-25T02:05:56.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.086 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 >> 172.21.15.57:0/1746336496 conn(0x7f33b00c5290 msgr2=0x7f33b00d6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.086 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 shutdown_connections 2024-04-25T02:05:56.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.086 7f33b61c1700 1 -- 172.21.15.57:0/1746336496 wait complete. 2024-04-25T02:05:56.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:05:56.104 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:05:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.190 7f39dd80f700 1 Processor -- start 2024-04-25T02:05:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.190 7f39dd80f700 1 -- start start 2024-04-25T02:05:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.190 7f39dd80f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80fb090 0x7f39d810c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.190 7f39dd80f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d81a1540 0x7f39d81a1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.190 7f39dd80f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d8104d90 con 0x7f39d810cce0 2024-04-25T02:05:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.190 7f39dd80f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d810d130 con 0x7f39d81a1540 2024-04-25T02:05:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.190 7f39dd80f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80f2200 con 0x7f39d80fb090 2024-04-25T02:05:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d5dc4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f39d810cce0 0x7f39d81a0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46746/0 (socket says 172.21.15.57:46746) 2024-04-25T02:05:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d5dc4700 1 -- 172.21.15.57:0/2472764143 learned_addr learned my addr 172.21.15.57:0/2472764143 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d6dc6700 1 --2- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d81a1540 0x7f39d81a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d65c5700 1 --2- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80fb090 0x7f39d810c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d65c5700 1 -- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d81a1540 msgr2=0x7f39d81a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d65c5700 1 --2- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d81a1540 0x7f39d81a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d65c5700 1 -- 172.21.15.57:0/2472764143 >> v1:172.21.15.57:6789/0 conn(0x7f39d810cce0 legacy=0x7f39d81a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d65c5700 1 -- 172.21.15.57:0/2472764143 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d81aa220 con 0x7f39d80fb090 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.191 7f39d65c5700 1 --2- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80fb090 0x7f39d810c6b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f39c0001380 tx=0x7f39c0001080).ready entity=mon.2 client_cookie=ed6f6757a4196b7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.192 7f39d55c3700 1 -- 172.21.15.57:0/2472764143 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39d81aa220 con 0x7f39d80fb090 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.192 7f39d55c3700 1 -- 172.21.15.57:0/2472764143 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d000b740 con 0x7f39d80fb090 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.192 7f39d55c3700 1 -- 172.21.15.57:0/2472764143 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39d000b920 con 0x7f39d80fb090 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.192 7f39dd80f700 1 -- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80fb090 msgr2=0x7f39d810c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.192 7f39dd80f700 1 --2- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80fb090 0x7f39d810c6b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f39c0001380 tx=0x7f39c0001080).stop 2024-04-25T02:05:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.193 7f39dd80f700 1 -- 172.21.15.57:0/2472764143 shutdown_connections 2024-04-25T02:05:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.193 7f39dd80f700 1 --2- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d81a1540 0x7f39d81a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.193 7f39dd80f700 1 --2- 172.21.15.57:0/2472764143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80fb090 0x7f39d810c6b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.193 7f39dd80f700 1 -- 172.21.15.57:0/2472764143 >> 172.21.15.57:0/2472764143 conn(0x7f39d81148b0 msgr2=0x7f39d8114d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.193 7f39dd80f700 1 -- 172.21.15.57:0/2472764143 shutdown_connections 2024-04-25T02:05:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.193 7f39dd80f700 1 -- 172.21.15.57:0/2472764143 wait complete. 2024-04-25T02:05:56.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.205 7fc6803aa700 1 Processor -- start 2024-04-25T02:05:56.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.205 7fc6803aa700 1 -- start start 2024-04-25T02:05:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.205 7fc6803aa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6780f5910 0x7fc6780f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.205 7fc6803aa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6780f2300 0x7fc67810eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.205 7fc6803aa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6780f9220 con 0x7fc6780f1eb0 2024-04-25T02:05:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.205 7fc6803aa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67810f0d0 con 0x7fc6780f2300 2024-04-25T02:05:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.205 7fc6803aa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6781ac670 con 0x7fc6780f5910 2024-04-25T02:05:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67d1a5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6780f5910 0x7fc6780f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67c9a4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc6780f1eb0 0x7fc67810e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46750/0 (socket says 172.21.15.57:46750) 2024-04-25T02:05:56.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67c9a4700 1 -- 172.21.15.57:0/694667510 learned_addr learned my addr 172.21.15.57:0/694667510 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67d9a6700 1 --2- 172.21.15.57:0/694667510 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6780f2300 0x7fc67810eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc667fff700 1 -- 172.21.15.57:0/694667510 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022876275 0 0) 0x7fc668001110 con 0x7fc6780f1eb0 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc667fff700 1 -- 172.21.15.57:0/694667510 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc660003270 con 0x7fc6780f1eb0 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67d1a5700 1 -- 172.21.15.57:0/694667510 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6780f2300 msgr2=0x7fc67810eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67d1a5700 1 --2- 172.21.15.57:0/694667510 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6780f2300 0x7fc67810eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67d1a5700 1 -- 172.21.15.57:0/694667510 >> v1:172.21.15.57:6789/0 conn(0x7fc6780f1eb0 legacy=0x7fc67810e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67d1a5700 1 -- 172.21.15.57:0/694667510 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6781ac820 con 0x7fc6780f5910 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc67d1a5700 1 --2- 172.21.15.57:0/694667510 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6780f5910 0x7fc6780f1880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc674002f70 tx=0x7fc67400b9a0).ready entity=mon.2 client_cookie=f786308937a43448 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.206 7fc667fff700 1 -- 172.21.15.57:0/694667510 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6781ac820 con 0x7fc6780f5910 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc667fff700 1 -- 172.21.15.57:0/694667510 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67400d570 con 0x7fc6780f5910 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc667fff700 1 -- 172.21.15.57:0/694667510 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc67400d940 con 0x7fc6780f5910 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc6803aa700 1 -- 172.21.15.57:0/694667510 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6780f5910 msgr2=0x7fc6780f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc6803aa700 1 --2- 172.21.15.57:0/694667510 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6780f5910 0x7fc6780f1880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc674002f70 tx=0x7fc67400b9a0).stop 2024-04-25T02:05:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc6803aa700 1 -- 172.21.15.57:0/694667510 shutdown_connections 2024-04-25T02:05:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc6803aa700 1 --2- 172.21.15.57:0/694667510 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6780f2300 0x7fc67810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc6803aa700 1 --2- 172.21.15.57:0/694667510 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6780f5910 0x7fc6780f1880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc6803aa700 1 -- 172.21.15.57:0/694667510 >> 172.21.15.57:0/694667510 conn(0x7fc678113a60 msgr2=0x7fc6780f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc6803aa700 1 -- 172.21.15.57:0/694667510 shutdown_connections 2024-04-25T02:05:56.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.207 7fc6803aa700 1 -- 172.21.15.57:0/694667510 wait complete. 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc6803aa700 1 Processor -- start 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc6803aa700 1 -- start start 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc6803aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6781b3890 0x7fc6781b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc6803aa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6781b4310 0x7fc6781b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc6803aa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6781b4d90 0x7fc6781b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc6803aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780c5a40 con 0x7fc6781b3890 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc6803aa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780c4e10 con 0x7fc6781b4310 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc6803aa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780bc9b0 con 0x7fc6781b4d90 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc67d1a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6781b3890 0x7fc6781b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc67d1a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6781b3890 0x7fc6781b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60696/0 (socket says 172.21.15.57:60696) 2024-04-25T02:05:56.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc67d1a5700 1 -- 172.21.15.57:0/1957481956 learned_addr learned my addr 172.21.15.57:0/1957481956 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc67c9a4700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6781b4310 0x7fc6781b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.232 7fc67d9a6700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6781b4d90 0x7fc6781b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc67d1a5700 1 -- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6781b4d90 msgr2=0x7fc6781b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc67d1a5700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6781b4d90 0x7fc6781b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc67d1a5700 1 -- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6781b4310 msgr2=0x7fc6781b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc67d1a5700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6781b4310 0x7fc6781b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc67d1a5700 1 -- 172.21.15.57:0/1957481956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780f01f0 con 0x7fc6781b3890 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc67d1a5700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6781b3890 0x7fc6781b3ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc6780c5260 tx=0x7fc6740068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc6667fc700 1 -- 172.21.15.57:0/1957481956 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6780f01f0 con 0x7fc6781b3890 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc6667fc700 1 -- 172.21.15.57:0/1957481956 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6740116e0 con 0x7fc6781b3890 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6781b5810 con 0x7fc6781b3890 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc6667fc700 1 -- 172.21.15.57:0/1957481956 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc674017040 con 0x7fc6781b3890 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.233 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6781bbf70 con 0x7fc6781b3890 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.234 7fc6667fc700 1 -- 172.21.15.57:0/1957481956 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc674011ab0 con 0x7fc6781b3890 2024-04-25T02:05:56.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.234 7fc6667fc700 1 -- 172.21.15.57:0/1957481956 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc674018070 con 0x7fc6781b3890 2024-04-25T02:05:56.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.235 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6780f08d0 con 0x7fc6781b3890 2024-04-25T02:05:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.237 7f39dd80f700 1 Processor -- start 2024-04-25T02:05:56.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.238 7fc6667fc700 1 -- 172.21.15.57:0/1957481956 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc6740114d0 con 0x7fc6781b3890 2024-04-25T02:05:56.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.238 7f39dd80f700 1 -- start start 2024-04-25T02:05:56.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39dd80f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80d8810 0x7f39d80d8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39dd80f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d80d9290 0x7f39d81b9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39dd80f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39d81b9690 0x7f39d81c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39dd80f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80d6350 con 0x7f39d81b9690 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39dd80f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80ba740 con 0x7f39d80d9290 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39dd80f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39d81ae4f0 con 0x7f39d80d8810 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d65c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80d8810 0x7f39d80d8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d65c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80d8810 0x7f39d80d8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39900/0 (socket says 172.21.15.57:39900) 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d65c5700 1 -- 172.21.15.57:0/1491648512 learned_addr learned my addr 172.21.15.57:0/1491648512 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d6dc6700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39d81b9690 0x7f39d81c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d65c5700 1 -- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d80d9290 msgr2=0x7f39d81b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d5dc4700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d80d9290 0x7f39d81b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d65c5700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d80d9290 0x7f39d81b9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d65c5700 1 -- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39d81b9690 msgr2=0x7f39d81c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d65c5700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39d81b9690 0x7f39d81c02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d65c5700 1 -- 172.21.15.57:0/1491648512 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80d0e00 con 0x7f39d80d8810 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d6dc6700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39d81b9690 0x7f39d81c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.239 7f39d5dc4700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d80d9290 0x7f39d81b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.240 7f39d65c5700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80d8810 0x7f39d80d8c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f39d80df7d0 tx=0x7f39d0006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.240 7f39cf7fe700 1 -- 172.21.15.57:0/1491648512 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39d0011a90 con 0x7f39d80d8810 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.240 7f39cf7fe700 1 -- 172.21.15.57:0/1491648512 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d001f020 con 0x7f39d80d8810 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.240 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d80c11c0 con 0x7f39d80d8810 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.240 7f39cf7fe700 1 -- 172.21.15.57:0/1491648512 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39d001b430 con 0x7f39d80d8810 2024-04-25T02:05:56.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.240 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d81b9cc0 con 0x7f39d80d8810 2024-04-25T02:05:56.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.241 7f39cf7fe700 1 -- 172.21.15.57:0/1491648512 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f39d00099e0 con 0x7f39d80d8810 2024-04-25T02:05:56.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.241 7f39cf7fe700 1 -- 172.21.15.57:0/1491648512 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f39d00146d0 con 0x7f39d80d8810 2024-04-25T02:05:56.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.242 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d80f0850 con 0x7f39d80d8810 2024-04-25T02:05:56.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.245 7f39cf7fe700 1 -- 172.21.15.57:0/1491648512 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f39d0011880 con 0x7f39d80d8810 2024-04-25T02:05:56.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.282 7ff75e3eb700 1 Processor -- start 2024-04-25T02:05:56.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.282 7ff75e3eb700 1 -- start start 2024-04-25T02:05:56.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff75e3eb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff75810b900 0x7ff7581a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff75e3eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7581a59c0 0x7ff7581a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff75e3eb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75810bd50 con 0x7ff7580f5a00 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff75e3eb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7580fa580 con 0x7ff75810b900 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff75e3eb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7581a0c40 con 0x7ff7581a59c0 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff757887700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7581a59c0 0x7ff7581a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff757887700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7581a59c0 0x7ff7581a7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47620/0 (socket says 172.21.15.57:47620) 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff757887700 1 -- 172.21.15.57:0/3975085274 learned_addr learned my addr 172.21.15.57:0/3975085274 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff757887700 1 -- 172.21.15.57:0/3975085274 >> v2:172.21.15.57:3300/0 conn(0x7ff75810b900 msgr2=0x7ff7581a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff757887700 1 --2- 172.21.15.57:0/3975085274 >> v2:172.21.15.57:3300/0 conn(0x7ff75810b900 0x7ff7581a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff757887700 1 -- 172.21.15.57:0/3975085274 >> v1:172.21.15.57:6789/0 conn(0x7ff7580f5a00 legacy=0x7ff75810b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff757887700 1 -- 172.21.15.57:0/3975085274 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7581a9460 con 0x7ff7581a59c0 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.283 7ff757887700 1 --2- 172.21.15.57:0/3975085274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7581a59c0 0x7ff7581a7e20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff7580f47b0 tx=0x7ff750009d90).ready entity=mon.1 client_cookie=ca7ed9e7f2301543 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff756084700 1 -- 172.21.15.57:0/3975085274 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7581a9460 con 0x7ff7581a59c0 2024-04-25T02:05:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff756084700 1 -- 172.21.15.57:0/3975085274 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75000b840 con 0x7ff7581a59c0 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff756084700 1 -- 172.21.15.57:0/3975085274 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff75000ba20 con 0x7ff7581a59c0 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff75e3eb700 1 -- 172.21.15.57:0/3975085274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7581a59c0 msgr2=0x7ff7581a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff75e3eb700 1 --2- 172.21.15.57:0/3975085274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7581a59c0 0x7ff7581a7e20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff7580f47b0 tx=0x7ff750009d90).stop 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff75e3eb700 1 -- 172.21.15.57:0/3975085274 shutdown_connections 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff75e3eb700 1 --2- 172.21.15.57:0/3975085274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7581a59c0 0x7ff7581a7e20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff75e3eb700 1 --2- 172.21.15.57:0/3975085274 >> v2:172.21.15.57:3300/0 conn(0x7ff75810b900 0x7ff7581a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.284 7ff75e3eb700 1 -- 172.21.15.57:0/3975085274 >> 172.21.15.57:0/3975085274 conn(0x7ff758113a60 msgr2=0x7ff7580f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.285 7ff75e3eb700 1 -- 172.21.15.57:0/3975085274 shutdown_connections 2024-04-25T02:05:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.285 7ff75e3eb700 1 -- 172.21.15.57:0/3975085274 wait complete. 2024-04-25T02:05:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.295 7f9d92123700 1 Processor -- start 2024-04-25T02:05:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.295 7f9d92123700 1 -- start start 2024-04-25T02:05:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.295 7f9d92123700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0f5890 0x7f9d8c0f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.295 7f9d92123700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0f1e30 0x7f9d8c10e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.295 7f9d92123700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c0f91a0 con 0x7f9d8c0f2280 2024-04-25T02:05:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.295 7f9d92123700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c10f050 con 0x7f9d8c0f1e30 2024-04-25T02:05:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.295 7f9d92123700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1ac5f0 con 0x7f9d8c0f5890 2024-04-25T02:05:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8adc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0f5890 0x7f9d8c0f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8adc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0f5890 0x7f9d8c0f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39912/0 (socket says 172.21.15.57:39912) 2024-04-25T02:05:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8b5c7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9d8c0f2280 0x7f9d8c10e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46776/0 (socket says 172.21.15.57:46776) 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8adc6700 1 -- 172.21.15.57:0/297679930 learned_addr learned my addr 172.21.15.57:0/297679930 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d89dc4700 1 -- 172.21.15.57:0/297679930 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410477246 0 0) 0x7f9d84001490 con 0x7f9d8c0f2280 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8adc6700 1 -- 172.21.15.57:0/297679930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0f1e30 msgr2=0x7f9d8c10e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8adc6700 1 --2- 172.21.15.57:0/297679930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0f1e30 0x7f9d8c10e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8adc6700 1 -- 172.21.15.57:0/297679930 >> v1:172.21.15.57:6789/0 conn(0x7f9d8c0f2280 legacy=0x7f9d8c10e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8adc6700 1 -- 172.21.15.57:0/297679930 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c1ac7a0 con 0x7f9d8c0f5890 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d8adc6700 1 --2- 172.21.15.57:0/297679930 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0f5890 0x7f9d8c0f1800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9d7c002f70 tx=0x7f9d7c009a00).ready entity=mon.2 client_cookie=d10fb0d5f60a06cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.296 7f9d89dc4700 1 -- 172.21.15.57:0/297679930 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d8c1ac7a0 con 0x7f9d8c0f5890 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d89dc4700 1 -- 172.21.15.57:0/297679930 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c00f510 con 0x7f9d8c0f5890 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d89dc4700 1 -- 172.21.15.57:0/297679930 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d7c00f6f0 con 0x7f9d8c0f5890 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d92123700 1 -- 172.21.15.57:0/297679930 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0f5890 msgr2=0x7f9d8c0f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d92123700 1 --2- 172.21.15.57:0/297679930 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0f5890 0x7f9d8c0f1800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9d7c002f70 tx=0x7f9d7c009a00).stop 2024-04-25T02:05:56.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d92123700 1 -- 172.21.15.57:0/297679930 shutdown_connections 2024-04-25T02:05:56.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d92123700 1 --2- 172.21.15.57:0/297679930 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0f5890 0x7f9d8c0f1800 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d92123700 1 --2- 172.21.15.57:0/297679930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0f1e30 0x7f9d8c10e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:56.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d92123700 1 -- 172.21.15.57:0/297679930 >> 172.21.15.57:0/297679930 conn(0x7f9d8c1139e0 msgr2=0x7f9d8c0f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d92123700 1 -- 172.21.15.57:0/297679930 shutdown_connections 2024-04-25T02:05:56.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.297 7f9d92123700 1 -- 172.21.15.57:0/297679930 wait complete. 2024-04-25T02:05:56.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.309 7ff75e3eb700 1 Processor -- start 2024-04-25T02:05:56.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.309 7ff75e3eb700 1 -- start start 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff75e3eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7581a1340 0x7ff7580d9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff75e3eb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7580da200 0x7ff7581b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff75e3eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7580da650 0x7ff7581b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff75e3eb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7580de4f0 con 0x7ff7580da200 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff75e3eb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7581b5150 con 0x7ff7580da650 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff75e3eb700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7581b5380 con 0x7ff7581a1340 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7580da650 0x7ff7581b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7580da650 0x7ff7581b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47642/0 (socket says 172.21.15.57:47642) 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 -- 172.21.15.57:0/4180476291 learned_addr learned my addr 172.21.15.57:0/4180476291 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757086700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7581a1340 0x7ff7580d9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff756885700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7580da200 0x7ff7581b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 -- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7581a1340 msgr2=0x7ff7580d9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7581a1340 0x7ff7580d9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 -- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7580da200 msgr2=0x7ff7581b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7580da200 0x7ff7581b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 -- 172.21.15.57:0/4180476291 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7581bbbe0 con 0x7ff7580da650 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff756885700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7580da200 0x7ff7581b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.310 7ff757887700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7580da650 0x7ff7581b4b20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff7580c4d50 tx=0x7ff750006c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.311 7ff754881700 1 -- 172.21.15.57:0/4180476291 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7581bbbe0 con 0x7ff7580da650 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.311 7ff754881700 1 -- 172.21.15.57:0/4180476291 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff750011d70 con 0x7ff7580da650 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.311 7ff754881700 1 -- 172.21.15.57:0/4180476291 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff750017040 con 0x7ff7580da650 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.311 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7581bbde0 con 0x7ff7580da650 2024-04-25T02:05:56.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.311 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7581bbfe0 con 0x7ff7580da650 2024-04-25T02:05:56.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.312 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7580f08d0 con 0x7ff7580da650 2024-04-25T02:05:56.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.312 7ff754881700 1 -- 172.21.15.57:0/4180476291 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff75001c660 con 0x7ff7580da650 2024-04-25T02:05:56.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.312 7ff754881700 1 -- 172.21.15.57:0/4180476291 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ff750018030 con 0x7ff7580da650 2024-04-25T02:05:56.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.318 7ff754881700 1 -- 172.21.15.57:0/4180476291 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ff750011b60 con 0x7ff7580da650 2024-04-25T02:05:56.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.323 7f9d92123700 1 Processor -- start 2024-04-25T02:05:56.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.323 7f9d92123700 1 -- start start 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.323 7f9d92123700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0c9bc0 0x7f9d8c0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.323 7f9d92123700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0ca640 0x7f9d8c1b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.323 7f9d92123700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c1b4e50 0x7f9d8c1bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.323 7f9d92123700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0d7100 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.323 7f9d92123700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0d66f0 con 0x7f9d8c0c9bc0 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.323 7f9d92123700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0d6920 con 0x7f9d8c0ca640 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c1b4e50 0x7f9d8c1bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c1b4e50 0x7f9d8c1bbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60738/0 (socket says 172.21.15.57:60738) 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 -- 172.21.15.57:0/1948700308 learned_addr learned my addr 172.21.15.57:0/1948700308 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 -- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0ca640 msgr2=0x7f9d8c1b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8a5c5700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0ca640 0x7f9d8c1b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0ca640 0x7f9d8c1b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8adc6700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0c9bc0 0x7f9d8c0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 -- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0c9bc0 msgr2=0x7f9d8c0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0c9bc0 0x7f9d8c0ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 -- 172.21.15.57:0/1948700308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c0d8350 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8a5c5700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0ca640 0x7f9d8c1b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8adc6700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0c9bc0 0x7f9d8c0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d8b5c7700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c1b4e50 0x7f9d8c1bbc80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9d84000f40 tx=0x7f9d8400cbb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.324 7f9d7bfff700 1 -- 172.21.15.57:0/1948700308 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d8c0d8350 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.325 7f9d7bfff700 1 -- 172.21.15.57:0/1948700308 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d84005af0 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.325 7f9d7bfff700 1 -- 172.21.15.57:0/1948700308 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9d84007110 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.325 7f9d92123700 1 -- 172.21.15.57:0/1948700308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c1b52a0 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.325 7f9d92123700 1 -- 172.21.15.57:0/1948700308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c1bc2b0 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.326 7f9d7bfff700 1 -- 172.21.15.57:0/1948700308 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9d8401a020 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.326 7f9d92123700 1 -- 172.21.15.57:0/1948700308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c0f0850 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.326 7f9d7bfff700 1 -- 172.21.15.57:0/1948700308 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f9d84009d90 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.329 7f9d7bfff700 1 -- 172.21.15.57:0/1948700308 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f9d84000fb0 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.366 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39d80e2430 con 0x7f39d80d8810 2024-04-25T02:05:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.367 7f39cf7fe700 1 -- 172.21.15.57:0/1491648512 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39d000b530 con 0x7f39d80d8810 2024-04-25T02:05:56.373 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-04-25T02:05:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.368 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 >> v1:172.21.15.57:6816/43033 conn(0x7f39bc0145b0 legacy=0x7f39bc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.368 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80d8810 msgr2=0x7f39d80d8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.368 7f39dd80f700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80d8810 0x7f39d80d8c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f39d80df7d0 tx=0x7f39d0006c40).stop 2024-04-25T02:05:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.369 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 shutdown_connections 2024-04-25T02:05:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.369 7f39dd80f700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39d81b9690 0x7f39d81c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.369 7f39dd80f700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39d80d8810 0x7f39d80d8c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.369 7f39dd80f700 1 --2- 172.21.15.57:0/1491648512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39d80d9290 0x7f39d81b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.369 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 >> 172.21.15.57:0/1491648512 conn(0x7f39d80da8b0 msgr2=0x7f39d80bbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.369 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 shutdown_connections 2024-04-25T02:05:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.369 7f39dd80f700 1 -- 172.21.15.57:0/1491648512 wait complete. 2024-04-25T02:05:56.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.1 2024-04-25T02:05:56.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.384 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6780e2f10 con 0x7fc6781b3890 2024-04-25T02:05:56.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.385 7fc6667fc700 1 -- 172.21.15.57:0/1957481956 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc67400d360 con 0x7fc6781b3890 2024-04-25T02:05:56.390 INFO:teuthology.orchestra.run.smithi057.stdout:38654705668 2024-04-25T02:05:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 >> v1:172.21.15.57:6816/43033 conn(0x7fc6580145b0 legacy=0x7fc658016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6781b3890 msgr2=0x7fc6781b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6781b3890 0x7fc6781b3ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc6780c5260 tx=0x7fc6740068c0).stop 2024-04-25T02:05:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 shutdown_connections 2024-04-25T02:05:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6781b4d90 0x7fc6781b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6781b3890 0x7fc6781b3ce0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 --2- 172.21.15.57:0/1957481956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6781b4310 0x7fc6781b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 >> 172.21.15.57:0/1957481956 conn(0x7fc6780e1150 msgr2=0x7fc6780d8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 shutdown_connections 2024-04-25T02:05:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.386 7fc6803aa700 1 -- 172.21.15.57:0/1957481956 wait complete. 2024-04-25T02:05:56.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.3 2024-04-25T02:05:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.444 7f9d92123700 1 -- 172.21.15.57:0/1948700308 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d8c0d7ac0 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.444 7f9d7bfff700 1 -- 172.21.15.57:0/1948700308 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d840058e0 con 0x7f9d8c1b4e50 2024-04-25T02:05:56.450 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-04-25T02:05:56.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.445 7f9d92123700 1 -- 172.21.15.57:0/1948700308 >> v1:172.21.15.57:6816/43033 conn(0x7f9d68014600 legacy=0x7f9d68016b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.445 7f9d92123700 1 -- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c1b4e50 msgr2=0x7f9d8c1bbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.445 7f9d92123700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c1b4e50 0x7f9d8c1bbc80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9d84000f40 tx=0x7f9d8400cbb0).stop 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.445 7f9d92123700 1 -- 172.21.15.57:0/1948700308 shutdown_connections 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.445 7f9d92123700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d8c1b4e50 0x7f9d8c1bbc80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.445 7f9d92123700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d8c0c9bc0 0x7f9d8c0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.445 7f9d92123700 1 --2- 172.21.15.57:0/1948700308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9d8c0ca640 0x7f9d8c1b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.445 7f9d92123700 1 -- 172.21.15.57:0/1948700308 >> 172.21.15.57:0/1948700308 conn(0x7f9d8c0dc7a0 msgr2=0x7f9d8c0c13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.446 7f9d92123700 1 -- 172.21.15.57:0/1948700308 shutdown_connections 2024-04-25T02:05:56.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.446 7f9d92123700 1 -- 172.21.15.57:0/1948700308 wait complete. 2024-04-25T02:05:56.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.2 2024-04-25T02:05:56.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.461 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff7580ab8d0 con 0x7ff7580da650 2024-04-25T02:05:56.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.461 7ff754881700 1 -- 172.21.15.57:0/4180476291 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff75000b630 con 0x7ff7580da650 2024-04-25T02:05:56.467 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-04-25T02:05:56.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.462 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 >> v1:172.21.15.57:6816/43033 conn(0x7ff7380145b0 legacy=0x7ff738016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.462 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7580da650 msgr2=0x7ff7581b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:56.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.462 7ff75e3eb700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7580da650 0x7ff7581b4b20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff7580c4d50 tx=0x7ff750006c40).stop 2024-04-25T02:05:56.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.462 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 shutdown_connections 2024-04-25T02:05:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.462 7ff75e3eb700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7580da650 0x7ff7581b4b20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.462 7ff75e3eb700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7581a1340 0x7ff7580d9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.462 7ff75e3eb700 1 --2- 172.21.15.57:0/4180476291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7580da200 0x7ff7581b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.462 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 >> 172.21.15.57:0/4180476291 conn(0x7ff7581a7d90 msgr2=0x7ff7580d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.463 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 shutdown_connections 2024-04-25T02:05:56.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:56.463 7ff75e3eb700 1 -- 172.21.15.57:0/4180476291 wait complete. 2024-04-25T02:05:56.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.0 2024-04-25T02:05:57.387 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:05:57.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:05:57.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:05:57.479 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:05:57.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.532 7fe2752fa700 1 Processor -- start 2024-04-25T02:05:57.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.532 7fe2752fa700 1 -- start start 2024-04-25T02:05:57.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe2752fa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe27010cb30 0x7fe2701a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe2752fa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2701a6bd0 0x7fe2701a9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe2752fa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27010cf80 con 0x7fe2700f5910 2024-04-25T02:05:57.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe2752fa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700fa280 con 0x7fe27010cb30 2024-04-25T02:05:57.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe2752fa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700f95b0 con 0x7fe2701a6bd0 2024-04-25T02:05:57.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe26e85d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2701a6bd0 0x7fe2701a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe267fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe27010cb30 0x7fe2701a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe26e85d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2701a6bd0 0x7fe2701a9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39930/0 (socket says 172.21.15.57:39930) 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe267fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe27010cb30 0x7fe2701a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47646/0 (socket says 172.21.15.57:47646) 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe26e85d700 1 -- 172.21.15.57:0/4149615363 learned_addr learned my addr 172.21.15.57:0/4149615363 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe26e05c700 1 --1- 172.21.15.57:0/4149615363 >> v1:172.21.15.57:6789/0 conn(0x7fe2700f5910 0x7fe27010c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46778/0 (socket says 172.21.15.57:46778) 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe26d85b700 1 -- 172.21.15.57:0/4149615363 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180658547 0 0) 0x7fe260001110 con 0x7fe2700f5910 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe26d85b700 1 -- 172.21.15.57:0/4149615363 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe250003270 con 0x7fe2700f5910 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.533 7fe26e85d700 1 -- 172.21.15.57:0/4149615363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe27010cb30 msgr2=0x7fe2701a65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe26e85d700 1 --2- 172.21.15.57:0/4149615363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe27010cb30 0x7fe2701a65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe26e85d700 1 -- 172.21.15.57:0/4149615363 >> v1:172.21.15.57:6789/0 conn(0x7fe2700f5910 legacy=0x7fe27010c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe26e85d700 1 -- 172.21.15.57:0/4149615363 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2701aa670 con 0x7fe2701a6bd0 2024-04-25T02:05:57.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe26e85d700 1 --2- 172.21.15.57:0/4149615363 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2701a6bd0 0x7fe2701a9030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe2700f4630 tx=0x7fe268009dc0).ready entity=mon.2 client_cookie=75feb3c0719d386c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe26d85b700 1 -- 172.21.15.57:0/4149615363 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2701aa670 con 0x7fe2701a6bd0 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe26d85b700 1 -- 172.21.15.57:0/4149615363 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26800b910 con 0x7fe2701a6bd0 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe26d85b700 1 -- 172.21.15.57:0/4149615363 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe26800baf0 con 0x7fe2701a6bd0 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe2752fa700 1 -- 172.21.15.57:0/4149615363 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2701a6bd0 msgr2=0x7fe2701a9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.534 7fe2752fa700 1 --2- 172.21.15.57:0/4149615363 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2701a6bd0 0x7fe2701a9030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe2700f4630 tx=0x7fe268009dc0).stop 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.535 7fe2752fa700 1 -- 172.21.15.57:0/4149615363 shutdown_connections 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.535 7fe2752fa700 1 --2- 172.21.15.57:0/4149615363 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2701a6bd0 0x7fe2701a9030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.535 7fe2752fa700 1 --2- 172.21.15.57:0/4149615363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe27010cb30 0x7fe2701a65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.535 7fe2752fa700 1 -- 172.21.15.57:0/4149615363 >> 172.21.15.57:0/4149615363 conn(0x7fe270113a60 msgr2=0x7fe2700f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.535 7fe2752fa700 1 -- 172.21.15.57:0/4149615363 shutdown_connections 2024-04-25T02:05:57.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.535 7fe2752fa700 1 -- 172.21.15.57:0/4149615363 wait complete. 2024-04-25T02:05:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.570 7f9a60991700 1 Processor -- start 2024-04-25T02:05:57.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.570 7f9a60991700 1 -- start start 2024-04-25T02:05:57.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a60991700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0f5910 0x7f9a5c10c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a60991700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c10c960 0x7f9a5c0f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a60991700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0f26b0 con 0x7f9a5c10cdb0 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a60991700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0fa280 con 0x7f9a5c0f5910 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a60991700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0f95b0 con 0x7f9a5c10c960 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a58dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c10c960 0x7f9a5c0f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a58dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c10c960 0x7f9a5c0f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39940/0 (socket says 172.21.15.57:39940) 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a58dfa700 1 -- 172.21.15.57:0/2607629101 learned_addr learned my addr 172.21.15.57:0/2607629101 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a58dfa700 1 -- 172.21.15.57:0/2607629101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0f5910 msgr2=0x7f9a5c10c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a58dfa700 1 --2- 172.21.15.57:0/2607629101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0f5910 0x7f9a5c10c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a58dfa700 1 -- 172.21.15.57:0/2607629101 >> v1:172.21.15.57:6789/0 conn(0x7f9a5c10cdb0 legacy=0x7f9a5c0f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.571 7f9a58dfa700 1 -- 172.21.15.57:0/2607629101 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c1aa5d0 con 0x7f9a5c10c960 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.572 7f9a58dfa700 1 --2- 172.21.15.57:0/2607629101 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c10c960 0x7f9a5c0f1880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9a50002f70 tx=0x7f9a50009a00).ready entity=mon.2 client_cookie=76740bd81f9cb62f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.572 7f9a4bfff700 1 -- 172.21.15.57:0/2607629101 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9a5c1aa5d0 con 0x7f9a5c10c960 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.572 7f9a4bfff700 1 -- 172.21.15.57:0/2607629101 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000f510 con 0x7f9a5c10c960 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.572 7f9a4bfff700 1 -- 172.21.15.57:0/2607629101 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9a5000f6f0 con 0x7f9a5c10c960 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.572 7f9a60991700 1 -- 172.21.15.57:0/2607629101 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c10c960 msgr2=0x7f9a5c0f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.572 7f9a60991700 1 --2- 172.21.15.57:0/2607629101 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c10c960 0x7f9a5c0f1880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9a50002f70 tx=0x7f9a50009a00).stop 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.573 7f9a60991700 1 -- 172.21.15.57:0/2607629101 shutdown_connections 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.573 7f9a60991700 1 --2- 172.21.15.57:0/2607629101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0f5910 0x7f9a5c10c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.573 7f9a60991700 1 --2- 172.21.15.57:0/2607629101 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c10c960 0x7f9a5c0f1880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.573 7f9a60991700 1 -- 172.21.15.57:0/2607629101 >> 172.21.15.57:0/2607629101 conn(0x7f9a5c113a60 msgr2=0x7f9a5c0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.573 7f9a60991700 1 -- 172.21.15.57:0/2607629101 shutdown_connections 2024-04-25T02:05:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.573 7f9a60991700 1 -- 172.21.15.57:0/2607629101 wait complete. 2024-04-25T02:05:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.579 7fe2752fa700 1 Processor -- start 2024-04-25T02:05:57.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.579 7fe2752fa700 1 -- start start 2024-04-25T02:05:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe2752fa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2700da3c0 0x7fe2701adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe2752fa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe2701ae120 0x7fe2701b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe2752fa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2701ae570 0x7fe2701b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe2752fa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700effd0 con 0x7fe2701ae570 2024-04-25T02:05:57.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe2752fa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700f7650 con 0x7fe2701ae120 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe2752fa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2701b51a0 con 0x7fe2700da3c0 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe26e05c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2700da3c0 0x7fe2701adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe26e85d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2701ae570 0x7fe2701b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe26e05c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2700da3c0 0x7fe2701adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39944/0 (socket says 172.21.15.57:39944) 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe26e05c700 1 -- 172.21.15.57:0/548445014 learned_addr learned my addr 172.21.15.57:0/548445014 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe267fff700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe2701ae120 0x7fe2701b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.580 7fe26e05c700 1 -- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe2701ae120 msgr2=0x7fe2701b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe26e05c700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe2701ae120 0x7fe2701b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe26e05c700 1 -- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2701ae570 msgr2=0x7fe2701b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe26e05c700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2701ae570 0x7fe2701b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe26e05c700 1 -- 172.21.15.57:0/548445014 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2701b53d0 con 0x7fe2700da3c0 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe26e85d700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2701ae570 0x7fe2701b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe26e05c700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2700da3c0 0x7fe2701adaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe2700c4fc0 tx=0x7fe26000c760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe2677fe700 1 -- 172.21.15.57:0/548445014 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2701b53d0 con 0x7fe2700da3c0 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe2677fe700 1 -- 172.21.15.57:0/548445014 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2600072e0 con 0x7fe2700da3c0 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe2677fe700 1 -- 172.21.15.57:0/548445014 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe260005750 con 0x7fe2700da3c0 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe2752fa700 1 -- 172.21.15.57:0/548445014 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2701bbcb0 con 0x7fe2700da3c0 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.581 7fe2752fa700 1 -- 172.21.15.57:0/548445014 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2701bc090 con 0x7fe2700da3c0 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.582 7fe2677fe700 1 -- 172.21.15.57:0/548445014 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe260005950 con 0x7fe2700da3c0 2024-04-25T02:05:57.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.582 7fe2677fe700 1 -- 172.21.15.57:0/548445014 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe260014d10 con 0x7fe2700da3c0 2024-04-25T02:05:57.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.584 7fe2752fa700 1 -- 172.21.15.57:0/548445014 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2700f08d0 con 0x7fe2700da3c0 2024-04-25T02:05:57.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.590 7fe2677fe700 1 -- 172.21.15.57:0/548445014 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe2600070d0 con 0x7fe2700da3c0 2024-04-25T02:05:57.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a60991700 1 Processor -- start 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a60991700 1 -- start start 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a60991700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0cdf20 0x7f9a5c0d6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a60991700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c0d6bb0 0x7f9a5c1b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a60991700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a5c1b2680 0x7f9a5c1b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a60991700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0d7000 con 0x7f9a5c1b2680 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a60991700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c1b3100 con 0x7f9a5c0cdf20 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a60991700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c1b9530 con 0x7f9a5c0d6bb0 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a58dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c0d6bb0 0x7f9a5c1b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a59dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a5c1b2680 0x7f9a5c1b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a58dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c0d6bb0 0x7f9a5c1b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39960/0 (socket says 172.21.15.57:39960) 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a58dfa700 1 -- 172.21.15.57:0/4158741004 learned_addr learned my addr 172.21.15.57:0/4158741004 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.601 7f9a59dfc700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a5c1b2680 0x7f9a5c1b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60758/0 (socket says 172.21.15.57:60758) 2024-04-25T02:05:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a595fb700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0cdf20 0x7f9a5c0d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a59dfc700 1 -- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c0d6bb0 msgr2=0x7f9a5c1b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a59dfc700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c0d6bb0 0x7f9a5c1b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a59dfc700 1 -- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0cdf20 msgr2=0x7f9a5c0d6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a59dfc700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0cdf20 0x7f9a5c0d6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a59dfc700 1 -- 172.21.15.57:0/4158741004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c1b96e0 con 0x7f9a5c1b2680 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a595fb700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0cdf20 0x7f9a5c0d6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a59dfc700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a5c1b2680 0x7f9a5c1b2ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9a5c0d7740 tx=0x7f9a5400c9b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a4a7fc700 1 -- 172.21.15.57:0/4158741004 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9a5c1b96e0 con 0x7f9a5c1b2680 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a4a7fc700 1 -- 172.21.15.57:0/4158741004 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a54006ab0 con 0x7f9a5c1b2680 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a4a7fc700 1 -- 172.21.15.57:0/4158741004 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9a54007030 con 0x7f9a5c1b2680 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.602 7f9a60991700 1 -- 172.21.15.57:0/4158741004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c1b98e0 con 0x7f9a5c1b2680 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.603 7f9a60991700 1 -- 172.21.15.57:0/4158741004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c1b9cc0 con 0x7f9a5c1b2680 2024-04-25T02:05:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.603 7f9a4a7fc700 1 -- 172.21.15.57:0/4158741004 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9a5401a020 con 0x7f9a5c1b2680 2024-04-25T02:05:57.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.604 7f9a4a7fc700 1 -- 172.21.15.57:0/4158741004 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f9a54013c60 con 0x7f9a5c1b2680 2024-04-25T02:05:57.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.604 7f9a60991700 1 -- 172.21.15.57:0/4158741004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c0f08d0 con 0x7f9a5c1b2680 2024-04-25T02:05:57.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.607 7f9a4a7fc700 1 -- 172.21.15.57:0/4158741004 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f9a540068a0 con 0x7f9a5c1b2680 2024-04-25T02:05:57.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.633 7fc3ef96f700 1 Processor -- start 2024-04-25T02:05:57.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.633 7fc3ef96f700 1 -- start start 2024-04-25T02:05:57.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3ef96f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e8106520 0x7fc3e810e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3ef96f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3e810ea80 0x7fc3e80f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3ef96f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e810eed0 0x7fc3e80f1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3ef96f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80fb660 con 0x7fc3e810ea80 2024-04-25T02:05:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3ef96f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8106970 con 0x7fc3e8106520 2024-04-25T02:05:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3ef96f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80f1c50 con 0x7fc3e810eed0 2024-04-25T02:05:57.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3e810ea80 0x7fc3e80f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3e810ea80 0x7fc3e80f0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60764/0 (socket says 172.21.15.57:60764) 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e77fe700 1 -- 172.21.15.57:0/1272618831 learned_addr learned my addr 172.21.15.57:0/1272618831 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3ecf6b700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e810eed0 0x7fc3e80f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e7fff700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e8106520 0x7fc3e810e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e77fe700 1 -- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e810eed0 msgr2=0x7fc3e80f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e77fe700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e810eed0 0x7fc3e80f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e77fe700 1 -- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e8106520 msgr2=0x7fc3e810e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e77fe700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e8106520 0x7fc3e810e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.634 7fc3e77fe700 1 -- 172.21.15.57:0/1272618831 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80f1e80 con 0x7fc3e810ea80 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3e77fe700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e810ea80 0x7fc3e80f0ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc3e80fb810 tx=0x7fc3dc009a80).ready entity=mon.0 client_cookie=57392e94795ed47e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3e6ffd700 1 -- 172.21.15.57:0/1272618831 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3e80f1e80 con 0x7fc3e810ea80 2024-04-25T02:05:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3e6ffd700 1 -- 172.21.15.57:0/1272618831 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00f510 con 0x7fc3e810ea80 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3e6ffd700 1 -- 172.21.15.57:0/1272618831 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3dc00f6f0 con 0x7fc3e810ea80 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3ef96f700 1 -- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e810ea80 msgr2=0x7fc3e80f0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3ef96f700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e810ea80 0x7fc3e80f0ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc3e80fb810 tx=0x7fc3dc009a80).stop 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3ef96f700 1 -- 172.21.15.57:0/1272618831 shutdown_connections 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3ef96f700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e810eed0 0x7fc3e80f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3ef96f700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e8106520 0x7fc3e810e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3ef96f700 1 --2- 172.21.15.57:0/1272618831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e810ea80 0x7fc3e80f0ff0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.635 7fc3ef96f700 1 -- 172.21.15.57:0/1272618831 >> 172.21.15.57:0/1272618831 conn(0x7fc3e8114930 msgr2=0x7fc3e8114d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.636 7fc3ef96f700 1 -- 172.21.15.57:0/1272618831 shutdown_connections 2024-04-25T02:05:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.636 7fc3ef96f700 1 -- 172.21.15.57:0/1272618831 wait complete. 2024-04-25T02:05:57.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3ef96f700 1 Processor -- start 2024-04-25T02:05:57.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3ef96f700 1 -- start start 2024-04-25T02:05:57.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3ef96f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e80ce030 0x7fc3e80d6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3ef96f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e80d6830 0x7fc3e81b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3ef96f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e80d6c80 0x7fc3e81b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3ef96f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8088e60 con 0x7fc3e80ce030 2024-04-25T02:05:57.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3ef96f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80cd7f0 con 0x7fc3e80d6830 2024-04-25T02:05:57.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3ef96f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80c46f0 con 0x7fc3e80d6c80 2024-04-25T02:05:57.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7f8536828700 1 Processor -- start 2024-04-25T02:05:57.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.660 7fc3e77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e80d6830 0x7fc3e81b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e80d6830 0x7fc3e81b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47698/0 (socket says 172.21.15.57:47698) 2024-04-25T02:05:57.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e77fe700 1 -- 172.21.15.57:0/2685958797 learned_addr learned my addr 172.21.15.57:0/2685958797 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e7fff700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e80ce030 0x7fc3e80d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3ecf6b700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e80d6c80 0x7fc3e81b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e77fe700 1 -- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e80d6c80 msgr2=0x7fc3e81b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e77fe700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e80d6c80 0x7fc3e81b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e77fe700 1 -- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e80ce030 msgr2=0x7fc3e80d6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e77fe700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e80ce030 0x7fc3e80d6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e77fe700 1 -- 172.21.15.57:0/2685958797 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e81b4e60 con 0x7fc3e80d6830 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e77fe700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e80d6830 0x7fc3e81b4200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc3e81b0c70 tx=0x7fc3dc0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f8536828700 1 -- start start 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f8536828700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f85301171f0 0x7f8530112780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f8536828700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8530112db0 0x7f8530106bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f8536828700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8530107a20 con 0x7f8530113200 2024-04-25T02:05:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f8536828700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85301083b0 con 0x7f85301171f0 2024-04-25T02:05:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f8536828700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8530108560 con 0x7f8530112db0 2024-04-25T02:05:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e57fa700 1 -- 172.21.15.57:0/2685958797 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3e81b4e60 con 0x7fc3e80d6830 2024-04-25T02:05:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f852edea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8530112db0 0x7f8530106bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f852edea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8530112db0 0x7f8530106bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39982/0 (socket says 172.21.15.57:39982) 2024-04-25T02:05:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7f852edea700 1 -- 172.21.15.57:0/2371185991 learned_addr learned my addr 172.21.15.57:0/2371185991 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:57.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e57fa700 1 -- 172.21.15.57:0/2685958797 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc01c650 con 0x7fc3e80d6830 2024-04-25T02:05:57.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.661 7fc3e57fa700 1 -- 172.21.15.57:0/2685958797 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3dc01ca20 con 0x7fc3e80d6830 2024-04-25T02:05:57.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7f852f5eb700 1 --2- 172.21.15.57:0/2371185991 >> v2:172.21.15.57:3300/0 conn(0x7f85301171f0 0x7f8530112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e81b5060 con 0x7fc3e80d6830 2024-04-25T02:05:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e81bbbe0 con 0x7fc3e80d6830 2024-04-25T02:05:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7f852edea700 1 -- 172.21.15.57:0/2371185991 >> v2:172.21.15.57:3300/0 conn(0x7f85301171f0 msgr2=0x7f8530112780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7f852edea700 1 --2- 172.21.15.57:0/2371185991 >> v2:172.21.15.57:3300/0 conn(0x7f85301171f0 0x7f8530112780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7f852edea700 1 -- 172.21.15.57:0/2371185991 >> v1:172.21.15.57:6789/0 conn(0x7f8530113200 legacy=0x7f8530107220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7f852edea700 1 -- 172.21.15.57:0/2371185991 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85301b0a90 con 0x7f8530112db0 2024-04-25T02:05:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7f852edea700 1 --2- 172.21.15.57:0/2371185991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8530112db0 0x7f8530106bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8524002f70 tx=0x7f85240099d0).ready entity=mon.2 client_cookie=51c6d520628d699 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.662 7fc3e57fa700 1 -- 172.21.15.57:0/2685958797 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc3dc019030 con 0x7fc3e80d6830 2024-04-25T02:05:57.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.663 7fc3e57fa700 1 -- 172.21.15.57:0/2685958797 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc3dc018040 con 0x7fc3e80d6830 2024-04-25T02:05:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.663 7f852e5e9700 1 -- 172.21.15.57:0/2371185991 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85301b0a90 con 0x7f8530112db0 2024-04-25T02:05:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.663 7f852e5e9700 1 -- 172.21.15.57:0/2371185991 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852400f510 con 0x7f8530112db0 2024-04-25T02:05:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.663 7f852e5e9700 1 -- 172.21.15.57:0/2371185991 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f852400f6f0 con 0x7f8530112db0 2024-04-25T02:05:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.663 7f8536828700 1 -- 172.21.15.57:0/2371185991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8530112db0 msgr2=0x7f8530106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.663 7f8536828700 1 --2- 172.21.15.57:0/2371185991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8530112db0 0x7f8530106bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8524002f70 tx=0x7f85240099d0).stop 2024-04-25T02:05:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.663 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e80f08d0 con 0x7fc3e80d6830 2024-04-25T02:05:57.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.664 7f8536828700 1 -- 172.21.15.57:0/2371185991 shutdown_connections 2024-04-25T02:05:57.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.664 7f8536828700 1 --2- 172.21.15.57:0/2371185991 >> v2:172.21.15.57:3300/0 conn(0x7f85301171f0 0x7f8530112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.664 7f8536828700 1 --2- 172.21.15.57:0/2371185991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8530112db0 0x7f8530106bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.664 7f8536828700 1 -- 172.21.15.57:0/2371185991 >> 172.21.15.57:0/2371185991 conn(0x7f85300f42b0 msgr2=0x7f85301166f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.664 7f8536828700 1 -- 172.21.15.57:0/2371185991 shutdown_connections 2024-04-25T02:05:57.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.664 7f8536828700 1 -- 172.21.15.57:0/2371185991 wait complete. 2024-04-25T02:05:57.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.669 7fc3e57fa700 1 -- 172.21.15.57:0/2685958797 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc3dc00f300 con 0x7fc3e80d6830 2024-04-25T02:05:57.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.688 7f8536828700 1 Processor -- start 2024-04-25T02:05:57.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f8536828700 1 -- start start 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f8536828700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85300d6200 0x7f85300d6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f8536828700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85300d6c80 0x7f85301b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f8536828700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85301b8ad0 0x7f85301b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f8536828700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300cae40 con 0x7f85301b8ad0 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f8536828700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85301b9550 con 0x7f85300d6c80 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f8536828700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85300ca6d0 con 0x7f85300d6200 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f852f5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85300d6200 0x7f85300d6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f852f5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85300d6200 0x7f85300d6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39986/0 (socket says 172.21.15.57:39986) 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f852f5eb700 1 -- 172.21.15.57:0/2582764660 learned_addr learned my addr 172.21.15.57:0/2582764660 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.689 7f852edea700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85300d6c80 0x7f85301b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852fdec700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85301b8ad0 0x7f85301b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852f5eb700 1 -- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85300d6c80 msgr2=0x7f85301b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852f5eb700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85300d6c80 0x7f85301b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852f5eb700 1 -- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85301b8ad0 msgr2=0x7f85301b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852f5eb700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85301b8ad0 0x7f85301b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852f5eb700 1 -- 172.21.15.57:0/2582764660 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300cb410 con 0x7f85300d6200 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852f5eb700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85300d6200 0x7f85300d6650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f85300c4d60 tx=0x7f852000ec80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852cde6700 1 -- 172.21.15.57:0/2582764660 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f85300cb410 con 0x7f85300d6200 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852cde6700 1 -- 172.21.15.57:0/2582764660 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000ca20 con 0x7f85300d6200 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f8536828700 1 -- 172.21.15.57:0/2582764660 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85301bfc10 con 0x7f85300d6200 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f852cde6700 1 -- 172.21.15.57:0/2582764660 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f852000f040 con 0x7f85300d6200 2024-04-25T02:05:57.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.690 7f8536828700 1 -- 172.21.15.57:0/2582764660 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85301bfff0 con 0x7f85300d6200 2024-04-25T02:05:57.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.691 7f852cde6700 1 -- 172.21.15.57:0/2582764660 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8520011070 con 0x7f85300d6200 2024-04-25T02:05:57.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.691 7f852cde6700 1 -- 172.21.15.57:0/2582764660 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8520010040 con 0x7f85300d6200 2024-04-25T02:05:57.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.691 7f8536828700 1 -- 172.21.15.57:0/2582764660 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85300f0850 con 0x7f85300d6200 2024-04-25T02:05:57.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.695 7f852cde6700 1 -- 172.21.15.57:0/2582764660 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f852000c620 con 0x7f85300d6200 2024-04-25T02:05:57.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.725 7fe2752fa700 1 -- 172.21.15.57:0/548445014 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe2701aec60 con 0x7fe2700da3c0 2024-04-25T02:05:57.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.726 7fe2677fe700 1 -- 172.21.15.57:0/548445014 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2700fefb0 con 0x7fe2700da3c0 2024-04-25T02:05:57.731 INFO:teuthology.orchestra.run.smithi057.stdout:38654705671 2024-04-25T02:05:57.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 -- 172.21.15.57:0/548445014 >> v1:172.21.15.57:6816/43033 conn(0x7fe254014540 legacy=0x7fe254016a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 -- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2700da3c0 msgr2=0x7fe2701adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2700da3c0 0x7fe2701adaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe2700c4fc0 tx=0x7fe26000c760).stop 2024-04-25T02:05:57.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7f9a60991700 1 -- 172.21.15.57:0/4158741004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a5c0a6080 con 0x7f9a5c1b2680 2024-04-25T02:05:57.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 -- 172.21.15.57:0/548445014 shutdown_connections 2024-04-25T02:05:57.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2701ae570 0x7fe2701b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe2700da3c0 0x7fe2701adaf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 --2- 172.21.15.57:0/548445014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe2701ae120 0x7fe2701b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 -- 172.21.15.57:0/548445014 >> 172.21.15.57:0/548445014 conn(0x7fe2700cf710 msgr2=0x7fe2700c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7f9a4a7fc700 1 -- 172.21.15.57:0/4158741004 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a5c1145e0 con 0x7f9a5c1b2680 2024-04-25T02:05:57.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 -- 172.21.15.57:0/548445014 shutdown_connections 2024-04-25T02:05:57.736 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-25T02:05:57.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.728 7fe2752fa700 1 -- 172.21.15.57:0/548445014 wait complete. 2024-04-25T02:05:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 -- 172.21.15.57:0/4158741004 >> v1:172.21.15.57:6816/43033 conn(0x7f9a380145b0 legacy=0x7f9a38016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 -- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a5c1b2680 msgr2=0x7f9a5c1b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a5c1b2680 0x7f9a5c1b2ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9a5c0d7740 tx=0x7f9a5400c9b0).stop 2024-04-25T02:05:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 -- 172.21.15.57:0/4158741004 shutdown_connections 2024-04-25T02:05:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a5c1b2680 0x7f9a5c1b2ad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a5c0cdf20 0x7f9a5c0d6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 --2- 172.21.15.57:0/4158741004 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a5c0d6bb0 0x7f9a5c1b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 -- 172.21.15.57:0/4158741004 >> 172.21.15.57:0/4158741004 conn(0x7f9a5c0c3a00 msgr2=0x7f9a5c0d78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 -- 172.21.15.57:0/4158741004 shutdown_connections 2024-04-25T02:05:57.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.730 7f9a60991700 1 -- 172.21.15.57:0/4158741004 wait complete. 2024-04-25T02:05:57.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-04-25T02:05:57.750 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:57.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-04-25T02:05:57.751 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:57.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.805 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3e80cd280 con 0x7fc3e80d6830 2024-04-25T02:05:57.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.805 7fc3e57fa700 1 -- 172.21.15.57:0/2685958797 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3dc035020 con 0x7fc3e80d6830 2024-04-25T02:05:57.811 INFO:teuthology.orchestra.run.smithi057.stdout:38654705671 2024-04-25T02:05:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 >> v1:172.21.15.57:6816/43033 conn(0x7fc3c80145b0 legacy=0x7fc3c8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e80d6830 msgr2=0x7fc3e81b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e80d6830 0x7fc3e81b4200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc3e81b0c70 tx=0x7fc3dc0068c0).stop 2024-04-25T02:05:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 shutdown_connections 2024-04-25T02:05:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3e80d6c80 0x7fc3e81b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3e80ce030 0x7fc3e80d6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 --2- 172.21.15.57:0/2685958797 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3e80d6830 0x7fc3e81b4200 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 >> 172.21.15.57:0/2685958797 conn(0x7fc3e80c3ac0 msgr2=0x7fc3e80db040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 shutdown_connections 2024-04-25T02:05:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.807 7fc3ef96f700 1 -- 172.21.15.57:0/2685958797 wait complete. 2024-04-25T02:05:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.809 7f8536828700 1 -- 172.21.15.57:0/2582764660 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f85300a6080 con 0x7f85300d6200 2024-04-25T02:05:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.810 7f852cde6700 1 -- 172.21.15.57:0/2582764660 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8520000c30 con 0x7f85300d6200 2024-04-25T02:05:57.816 INFO:teuthology.orchestra.run.smithi057.stdout:38654705671 2024-04-25T02:05:57.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 -- 172.21.15.57:0/2582764660 >> v1:172.21.15.57:6816/43033 conn(0x7f85100145b0 legacy=0x7f8510016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 -- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85300d6200 msgr2=0x7f85300d6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:57.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85300d6200 0x7f85300d6650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f85300c4d60 tx=0x7f852000ec80).stop 2024-04-25T02:05:57.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 -- 172.21.15.57:0/2582764660 shutdown_connections 2024-04-25T02:05:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85301b8ad0 0x7f85301b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85300d6200 0x7f85300d6650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 --2- 172.21.15.57:0/2582764660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85300d6c80 0x7f85301b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 -- 172.21.15.57:0/2582764660 >> 172.21.15.57:0/2582764660 conn(0x7f85300c58b0 msgr2=0x7f85300cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 -- 172.21.15.57:0/2582764660 shutdown_connections 2024-04-25T02:05:57.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.811 7f8536828700 1 -- 172.21.15.57:0/2582764660 wait complete. 2024-04-25T02:05:57.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-04-25T02:05:57.825 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:57.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-04-25T02:05:57.828 DEBUG:teuthology.parallel:result is None 2024-04-25T02:05:57.828 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:05:57.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:05:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.994 7ff85a0d8700 1 Processor -- start 2024-04-25T02:05:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.994 7ff85a0d8700 1 -- start start 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff85a0d8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540f5a10 0x7ff85410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff85a0d8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff85410b740 0x7ff85419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff85a0d8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff85410bb90 0x7ff8541a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff85a0d8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8540fa590 con 0x7ff85410b740 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff85a0d8700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8541a08a0 con 0x7ff8540f5a10 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff85a0d8700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8541a0ad0 con 0x7ff85410bb90 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8535c7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff85410bb90 0x7ff8541a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff85410b740 0x7ff85419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff852dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540f5a10 0x7ff85410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff85410b740 0x7ff85419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60784/0 (socket says 172.21.15.57:60784) 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8535c7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff85410bb90 0x7ff8541a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39990/0 (socket says 172.21.15.57:39990) 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 -- 172.21.15.57:0/931213228 learned_addr learned my addr 172.21.15.57:0/931213228 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 -- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff85410bb90 msgr2=0x7ff8541a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:58.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff85410bb90 0x7ff8541a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 -- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540f5a10 msgr2=0x7ff85410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540f5a10 0x7ff85410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 -- 172.21.15.57:0/931213228 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8541a73b0 con 0x7ff85410b740 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff852dc6700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540f5a10 0x7ff85410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8535c7700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff85410bb90 0x7ff8541a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.995 7ff8525c5700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff85410b740 0x7ff85419fc40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff83c002f70 tx=0x7ff83c009a50).ready entity=mon.0 client_cookie=9dfa0cf21eea4330 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff851dc4700 1 -- 172.21.15.57:0/931213228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff8541a73b0 con 0x7ff85410b740 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff851dc4700 1 -- 172.21.15.57:0/931213228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00f510 con 0x7ff85410b740 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff851dc4700 1 -- 172.21.15.57:0/931213228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff83c00f6f0 con 0x7ff85410b740 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 -- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff85410b740 msgr2=0x7ff85419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff85410b740 0x7ff85419fc40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff83c002f70 tx=0x7ff83c009a50).stop 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 -- 172.21.15.57:0/931213228 shutdown_connections 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff85410bb90 0x7ff8541a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540f5a10 0x7ff85410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 --2- 172.21.15.57:0/931213228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff85410b740 0x7ff85419fc40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 -- 172.21.15.57:0/931213228 >> 172.21.15.57:0/931213228 conn(0x7ff854113a70 msgr2=0x7ff8540f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 -- 172.21.15.57:0/931213228 shutdown_connections 2024-04-25T02:05:58.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:57.996 7ff85a0d8700 1 -- 172.21.15.57:0/931213228 wait complete. 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.020 7ff85a0d8700 1 Processor -- start 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.020 7ff85a0d8700 1 -- start start 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff85a0d8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8540d7310 0x7ff8540ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff85a0d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8540cea20 0x7ff8541b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff85a0d8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540cee70 0x7ff8541b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff85a0d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540f0150 con 0x7ff8540cea20 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff85a0d8700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540dd330 con 0x7ff8540cee70 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff85a0d8700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8541b1180 con 0x7ff8540d7310 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8540d7310 0x7ff8540ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff8525c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8540cea20 0x7ff8541b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8540d7310 0x7ff8540ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:39994/0 (socket says 172.21.15.57:39994) 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff8535c7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540cee70 0x7ff8541b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 -- 172.21.15.57:0/1278946976 learned_addr learned my addr 172.21.15.57:0/1278946976 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 -- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540cee70 msgr2=0x7ff8541b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 --2- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540cee70 0x7ff8541b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 -- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8540cea20 msgr2=0x7ff8541b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 --2- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8540cea20 0x7ff8541b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 -- 172.21.15.57:0/1278946976 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8541b13b0 con 0x7ff8540d7310 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff8525c5700 1 --2- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8540cea20 0x7ff8541b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff852dc6700 1 --2- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8540d7310 0x7ff8540ce3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff8541a4400 tx=0x7ff84400ecb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff84bfff700 1 -- 172.21.15.57:0/1278946976 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff8541b13b0 con 0x7ff8540d7310 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff84bfff700 1 -- 172.21.15.57:0/1278946976 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84400c9c0 con 0x7ff8540d7310 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff84bfff700 1 -- 172.21.15.57:0/1278946976 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff84400f040 con 0x7ff8540d7310 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8541b7c90 con 0x7ff8540d7310 2024-04-25T02:05:58.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.021 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8541b8070 con 0x7ff8540d7310 2024-04-25T02:05:58.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.022 7ff84bfff700 1 -- 172.21.15.57:0/1278946976 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff844011070 con 0x7ff8540d7310 2024-04-25T02:05:58.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.022 7ff84bfff700 1 -- 172.21.15.57:0/1278946976 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ff844010040 con 0x7ff8540d7310 2024-04-25T02:05:58.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.022 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8540f08e0 con 0x7ff8540d7310 2024-04-25T02:05:58.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.026 7ff84bfff700 1 -- 172.21.15.57:0/1278946976 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ff84400c5c0 con 0x7ff8540d7310 2024-04-25T02:05:58.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.134 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7ff854087810 con 0x7ff8380145b0 2024-04-25T02:05:58.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.142 7ff84bfff700 1 -- 172.21.15.57:0/1278946976 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306092 (unknown 2965378022 0 2099062542) 0x7ff83c006bf0 con 0x7ff8380145b0 2024-04-25T02:05:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:58.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 >> v1:172.21.15.57:6816/43033 conn(0x7ff8380145b0 legacy=0x7ff838016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8540d7310 msgr2=0x7ff8540ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 --2- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8540d7310 0x7ff8540ce3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff8541a4400 tx=0x7ff84400ecb0).stop 2024-04-25T02:05:58.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 shutdown_connections 2024-04-25T02:05:58.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 --2- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8540cee70 0x7ff8541b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 --2- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8540d7310 0x7ff8540ce3f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 --2- 172.21.15.57:0/1278946976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8540cea20 0x7ff8541b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 >> 172.21.15.57:0/1278946976 conn(0x7ff8540e0660 msgr2=0x7ff8540c2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:58.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 shutdown_connections 2024-04-25T02:05:58.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.145 7ff85a0d8700 1 -- 172.21.15.57:0/1278946976 wait complete. 2024-04-25T02:05:58.157 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:05:58.161 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25 02:05:56.667485","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001357"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372976","last_change":"2024-04-25 02:05:47.369320","last_active":"2024-04-25 02:05:47.372976","last_peered":"2024-04-25 02:05:47.372976","last_clean":"2024-04-25 02:05:47.372976","last_became_active":"2024-04-25 02:05:47.369008","last_became_peered":"2024-04-25 02:05:47.369008","last_unstale":"2024-04-25 02:05:47.372976","last_undegraded":"2024-04-25 02:05:47.372976","last_fullsized":"2024-04-25 02:05:47.372976","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358525","last_change":"2024-04-25 02:05:47.021686","last_active":"2024-04-25 02:05:47.358525","last_peered":"2024-04-25 02:05:47.358525","last_clean":"2024-04-25 02:05:47.358525","last_became_active":"2024-04-25 02:05:47.020938","last_became_peered":"2024-04-25 02:05:47.020938","last_unstale":"2024-04-25 02:05:47.358525","last_undegraded":"2024-04-25 02:05:47.358525","last_fullsized":"2024-04-25 02:05:47.358525","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388999","last_change":"2024-04-25 02:05:47.384312","last_active":"2024-04-25 02:05:47.388999","last_peered":"2024-04-25 02:05:47.388999","last_clean":"2024-04-25 02:05:47.388999","last_became_active":"2024-04-25 02:05:47.378585","last_became_peered":"2024-04-25 02:05:47.378585","last_unstale":"2024-04-25 02:05:47.388999","last_undegraded":"2024-04-25 02:05:47.388999","last_fullsized":"2024-04-25 02:05:47.388999","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363658","last_change":"2024-04-25 02:05:47.020533","last_active":"2024-04-25 02:05:47.363658","last_peered":"2024-04-25 02:05:47.363658","last_clean":"2024-04-25 02:05:47.363658","last_became_active":"2024-04-25 02:05:47.019990","last_became_peered":"2024-04-25 02:05:47.019990","last_unstale":"2024-04-25 02:05:47.363658","last_undegraded":"2024-04-25 02:05:47.363658","last_fullsized":"2024-04-25 02:05:47.363658","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388734","last_change":"2024-04-25 02:05:47.379801","last_active":"2024-04-25 02:05:47.388734","last_peered":"2024-04-25 02:05:47.388734","last_clean":"2024-04-25 02:05:47.388734","last_became_active":"2024-04-25 02:05:47.379321","last_became_peered":"2024-04-25 02:05:47.379321","last_unstale":"2024-04-25 02:05:47.388734","last_undegraded":"2024-04-25 02:05:47.388734","last_fullsized":"2024-04-25 02:05:47.388734","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357766","last_change":"2024-04-25 02:05:47.020828","last_active":"2024-04-25 02:05:47.357766","last_peered":"2024-04-25 02:05:47.357766","last_clean":"2024-04-25 02:05:47.357766","last_became_active":"2024-04-25 02:05:47.020320","last_became_peered":"2024-04-25 02:05:47.020320","last_unstale":"2024-04-25 02:05:47.357766","last_undegraded":"2024-04-25 02:05:47.357766","last_fullsized":"2024-04-25 02:05:47.357766","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373126","last_change":"2024-04-25 02:05:47.365068","last_active":"2024-04-25 02:05:47.373126","last_peered":"2024-04-25 02:05:47.373126","last_clean":"2024-04-25 02:05:47.373126","last_became_active":"2024-04-25 02:05:47.364768","last_became_peered":"2024-04-25 02:05:47.364768","last_unstale":"2024-04-25 02:05:47.373126","last_undegraded":"2024-04-25 02:05:47.373126","last_fullsized":"2024-04-25 02:05:47.373126","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.355780","last_change":"2024-04-25 02:05:47.028823","last_active":"2024-04-25 02:05:47.355780","last_peered":"2024-04-25 02:05:47.355780","last_clean":"2024-04-25 02:05:47.355780","last_became_active":"2024-04-25 02:05:47.027770","last_became_peered":"2024-04-25 02:05:47.027770","last_unstale":"2024-04-25 02:05:47.355780","last_undegraded":"2024-04-25 02:05:47.355780","last_fullsized":"2024-04-25 02:05:47.355780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382006","last_change":"2024-04-25 02:05:47.377307","last_active":"2024-04-25 02:05:47.382006","last_peered":"2024-04-25 02:05:47.382006","last_clean":"2024-04-25 02:05:47.382006","last_became_active":"2024-04-25 02:05:47.376546","last_became_peered":"2024-04-25 02:05:47.376546","last_unstale":"2024-04-25 02:05:47.382006","last_undegraded":"2024-04-25 02:05:47.382006","last_fullsized":"2024-04-25 02:05:47.382006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353187","last_change":"2024-04-25 02:05:46.996093","last_active":"2024-04-25 02:05:47.353187","last_peered":"2024-04-25 02:05:47.353187","last_clean":"2024-04-25 02:05:47.353187","last_became_active":"2024-04-25 02:05:46.995769","last_became_peered":"2024-04-25 02:05:46.995769","last_unstale":"2024-04-25 02:05:47.353187","last_undegraded":"2024-04-25 02:05:47.353187","last_fullsized":"2024-04-25 02:05:47.353187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390769","last_change":"2024-04-25 02:05:47.385883","last_active":"2024-04-25 02:05:47.390769","last_peered":"2024-04-25 02:05:47.390769","last_clean":"2024-04-25 02:05:47.390769","last_became_active":"2024-04-25 02:05:47.385568","last_became_peered":"2024-04-25 02:05:47.385568","last_unstale":"2024-04-25 02:05:47.390769","last_undegraded":"2024-04-25 02:05:47.390769","last_fullsized":"2024-04-25 02:05:47.390769","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362579","last_change":"2024-04-25 02:05:47.006764","last_active":"2024-04-25 02:05:47.362579","last_peered":"2024-04-25 02:05:47.362579","last_clean":"2024-04-25 02:05:47.362579","last_became_active":"2024-04-25 02:05:47.006519","last_became_peered":"2024-04-25 02:05:47.006519","last_unstale":"2024-04-25 02:05:47.362579","last_undegraded":"2024-04-25 02:05:47.362579","last_fullsized":"2024-04-25 02:05:47.362579","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391008","last_change":"2024-04-25 02:05:47.385392","last_active":"2024-04-25 02:05:47.391008","last_peered":"2024-04-25 02:05:47.391008","last_clean":"2024-04-25 02:05:47.391008","last_became_active":"2024-04-25 02:05:47.385092","last_became_peered":"2024-04-25 02:05:47.385092","last_unstale":"2024-04-25 02:05:47.391008","last_undegraded":"2024-04-25 02:05:47.391008","last_fullsized":"2024-04-25 02:05:47.391008","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387246","last_change":"2024-04-25 02:05:47.003242","last_active":"2024-04-25 02:05:47.387246","last_peered":"2024-04-25 02:05:47.387246","last_clean":"2024-04-25 02:05:47.387246","last_became_active":"2024-04-25 02:05:47.002466","last_became_peered":"2024-04-25 02:05:47.002466","last_unstale":"2024-04-25 02:05:47.387246","last_undegraded":"2024-04-25 02:05:47.387246","last_fullsized":"2024-04-25 02:05:47.387246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390926","last_change":"2024-04-25 02:05:47.387162","last_active":"2024-04-25 02:05:47.390926","last_peered":"2024-04-25 02:05:47.390926","last_clean":"2024-04-25 02:05:47.390926","last_became_active":"2024-04-25 02:05:47.386846","last_became_peered":"2024-04-25 02:05:47.386846","last_unstale":"2024-04-25 02:05:47.390926","last_undegraded":"2024-04-25 02:05:47.390926","last_fullsized":"2024-04-25 02:05:47.390926","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390398","last_change":"2024-04-25 02:05:47.012882","last_active":"2024-04-25 02:05:47.390398","last_peered":"2024-04-25 02:05:47.390398","last_clean":"2024-04-25 02:05:47.390398","last_became_active":"2024-04-25 02:05:47.012356","last_became_peered":"2024-04-25 02:05:47.012356","last_unstale":"2024-04-25 02:05:47.390398","last_undegraded":"2024-04-25 02:05:47.390398","last_fullsized":"2024-04-25 02:05:47.390398","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.381620","last_change":"2024-04-25 02:05:47.376840","last_active":"2024-04-25 02:05:47.381620","last_peered":"2024-04-25 02:05:47.381620","last_clean":"2024-04-25 02:05:47.381620","last_became_active":"2024-04-25 02:05:47.376550","last_became_peered":"2024-04-25 02:05:47.376550","last_unstale":"2024-04-25 02:05:47.381620","last_undegraded":"2024-04-25 02:05:47.381620","last_fullsized":"2024-04-25 02:05:47.381620","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390373","last_change":"2024-04-25 02:05:47.013902","last_active":"2024-04-25 02:05:47.390373","last_peered":"2024-04-25 02:05:47.390373","last_clean":"2024-04-25 02:05:47.390373","last_became_active":"2024-04-25 02:05:47.013571","last_became_peered":"2024-04-25 02:05:47.013571","last_unstale":"2024-04-25 02:05:47.390373","last_undegraded":"2024-04-25 02:05:47.390373","last_fullsized":"2024-04-25 02:05:47.390373","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391228","last_change":"2024-04-25 02:05:47.388939","last_active":"2024-04-25 02:05:47.391228","last_peered":"2024-04-25 02:05:47.391228","last_clean":"2024-04-25 02:05:47.391228","last_became_active":"2024-04-25 02:05:47.388673","last_became_peered":"2024-04-25 02:05:47.388673","last_unstale":"2024-04-25 02:05:47.391228","last_undegraded":"2024-04-25 02:05:47.391228","last_fullsized":"2024-04-25 02:05:47.391228","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363555","last_change":"2024-04-25 02:05:47.016797","last_active":"2024-04-25 02:05:47.363555","last_peered":"2024-04-25 02:05:47.363555","last_clean":"2024-04-25 02:05:47.363555","last_became_active":"2024-04-25 02:05:47.016484","last_became_peered":"2024-04-25 02:05:47.016484","last_unstale":"2024-04-25 02:05:47.363555","last_undegraded":"2024-04-25 02:05:47.363555","last_fullsized":"2024-04-25 02:05:47.363555","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373750","last_change":"2024-04-25 02:05:47.363022","last_active":"2024-04-25 02:05:47.373750","last_peered":"2024-04-25 02:05:47.373750","last_clean":"2024-04-25 02:05:47.373750","last_became_active":"2024-04-25 02:05:47.362681","last_became_peered":"2024-04-25 02:05:47.362681","last_unstale":"2024-04-25 02:05:47.373750","last_undegraded":"2024-04-25 02:05:47.373750","last_fullsized":"2024-04-25 02:05:47.373750","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360184","last_change":"2024-04-25 02:05:47.012986","last_active":"2024-04-25 02:05:47.360184","last_peered":"2024-04-25 02:05:47.360184","last_clean":"2024-04-25 02:05:47.360184","last_became_active":"2024-04-25 02:05:47.012673","last_became_peered":"2024-04-25 02:05:47.012673","last_unstale":"2024-04-25 02:05:47.360184","last_undegraded":"2024-04-25 02:05:47.360184","last_fullsized":"2024-04-25 02:05:47.360184","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388639","last_change":"2024-04-25 02:05:47.378766","last_active":"2024-04-25 02:05:47.388639","last_peered":"2024-04-25 02:05:47.388639","last_clean":"2024-04-25 02:05:47.388639","last_became_active":"2024-04-25 02:05:47.376368","last_became_peered":"2024-04-25 02:05:47.376368","last_unstale":"2024-04-25 02:05:47.388639","last_undegraded":"2024-04-25 02:05:47.388639","last_fullsized":"2024-04-25 02:05:47.388639","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386504","last_change":"2024-04-25 02:05:47.003903","last_active":"2024-04-25 02:05:47.386504","last_peered":"2024-04-25 02:05:47.386504","last_clean":"2024-04-25 02:05:47.386504","last_became_active":"2024-04-25 02:05:47.003584","last_became_peered":"2024-04-25 02:05:47.003584","last_unstale":"2024-04-25 02:05:47.386504","last_undegraded":"2024-04-25 02:05:47.386504","last_fullsized":"2024-04-25 02:05:47.386504","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391545","last_change":"2024-04-25 02:05:47.382468","last_active":"2024-04-25 02:05:47.391545","last_peered":"2024-04-25 02:05:47.391545","last_clean":"2024-04-25 02:05:47.391545","last_became_active":"2024-04-25 02:05:47.382161","last_became_peered":"2024-04-25 02:05:47.382161","last_unstale":"2024-04-25 02:05:47.391545","last_undegraded":"2024-04-25 02:05:47.391545","last_fullsized":"2024-04-25 02:05:47.391545","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380007","last_change":"2024-04-25 02:05:47.014185","last_active":"2024-04-25 02:05:47.380007","last_peered":"2024-04-25 02:05:47.380007","last_clean":"2024-04-25 02:05:47.380007","last_became_active":"2024-04-25 02:05:47.013874","last_became_peered":"2024-04-25 02:05:47.013874","last_unstale":"2024-04-25 02:05:47.380007","last_undegraded":"2024-04-25 02:05:47.380007","last_fullsized":"2024-04-25 02:05:47.380007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383613","last_change":"2024-04-25 02:05:47.375244","last_active":"2024-04-25 02:05:47.383613","last_peered":"2024-04-25 02:05:47.383613","last_clean":"2024-04-25 02:05:47.383613","last_became_active":"2024-04-25 02:05:47.374904","last_became_peered":"2024-04-25 02:05:47.374904","last_unstale":"2024-04-25 02:05:47.383613","last_undegraded":"2024-04-25 02:05:47.383613","last_fullsized":"2024-04-25 02:05:47.383613","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391628","last_change":"2024-04-25 02:05:47.013961","last_active":"2024-04-25 02:05:47.391628","last_peered":"2024-04-25 02:05:47.391628","last_clean":"2024-04-25 02:05:47.391628","last_became_active":"2024-04-25 02:05:47.013634","last_became_peered":"2024-04-25 02:05:47.013634","last_unstale":"2024-04-25 02:05:47.391628","last_undegraded":"2024-04-25 02:05:47.391628","last_fullsized":"2024-04-25 02:05:47.391628","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387497","last_change":"2024-04-25 02:05:47.380961","last_active":"2024-04-25 02:05:47.387497","last_peered":"2024-04-25 02:05:47.387497","last_clean":"2024-04-25 02:05:47.387497","last_became_active":"2024-04-25 02:05:47.380213","last_became_peered":"2024-04-25 02:05:47.380213","last_unstale":"2024-04-25 02:05:47.387497","last_undegraded":"2024-04-25 02:05:47.387497","last_fullsized":"2024-04-25 02:05:47.387497","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353098","last_change":"2024-04-25 02:05:47.002799","last_active":"2024-04-25 02:05:47.353098","last_peered":"2024-04-25 02:05:47.353098","last_clean":"2024-04-25 02:05:47.353098","last_became_active":"2024-04-25 02:05:47.002131","last_became_peered":"2024-04-25 02:05:47.002131","last_unstale":"2024-04-25 02:05:47.353098","last_undegraded":"2024-04-25 02:05:47.353098","last_fullsized":"2024-04-25 02:05:47.353098","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386374","last_change":"2024-04-25 02:05:47.372655","last_active":"2024-04-25 02:05:47.386374","last_peered":"2024-04-25 02:05:47.386374","last_clean":"2024-04-25 02:05:47.386374","last_became_active":"2024-04-25 02:05:47.372344","last_became_peered":"2024-04-25 02:05:47.372344","last_unstale":"2024-04-25 02:05:47.386374","last_undegraded":"2024-04-25 02:05:47.386374","last_fullsized":"2024-04-25 02:05:47.386374","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352064","last_change":"2024-04-25 02:05:46.999849","last_active":"2024-04-25 02:05:47.352064","last_peered":"2024-04-25 02:05:47.352064","last_clean":"2024-04-25 02:05:47.352064","last_became_active":"2024-04-25 02:05:46.999494","last_became_peered":"2024-04-25 02:05:46.999494","last_unstale":"2024-04-25 02:05:47.352064","last_undegraded":"2024-04-25 02:05:47.352064","last_fullsized":"2024-04-25 02:05:47.352064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388549","last_change":"2024-04-25 02:05:47.377522","last_active":"2024-04-25 02:05:47.388549","last_peered":"2024-04-25 02:05:47.388549","last_clean":"2024-04-25 02:05:47.388549","last_became_active":"2024-04-25 02:05:47.374641","last_became_peered":"2024-04-25 02:05:47.374641","last_unstale":"2024-04-25 02:05:47.388549","last_undegraded":"2024-04-25 02:05:47.388549","last_fullsized":"2024-04-25 02:05:47.388549","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389608","last_change":"2024-04-25 02:05:47.017557","last_active":"2024-04-25 02:05:47.389608","last_peered":"2024-04-25 02:05:47.389608","last_clean":"2024-04-25 02:05:47.389608","last_became_active":"2024-04-25 02:05:47.017189","last_became_peered":"2024-04-25 02:05:47.017189","last_unstale":"2024-04-25 02:05:47.389608","last_undegraded":"2024-04-25 02:05:47.389608","last_fullsized":"2024-04-25 02:05:47.389608","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389984","last_change":"2024-04-25 02:05:47.386122","last_active":"2024-04-25 02:05:47.389984","last_peered":"2024-04-25 02:05:47.389984","last_clean":"2024-04-25 02:05:47.389984","last_became_active":"2024-04-25 02:05:47.385756","last_became_peered":"2024-04-25 02:05:47.385756","last_unstale":"2024-04-25 02:05:47.389984","last_undegraded":"2024-04-25 02:05:47.389984","last_fullsized":"2024-04-25 02:05:47.389984","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352989","last_change":"2024-04-25 02:05:47.019790","last_active":"2024-04-25 02:05:47.352989","last_peered":"2024-04-25 02:05:47.352989","last_clean":"2024-04-25 02:05:47.352989","last_became_active":"2024-04-25 02:05:47.019471","last_became_peered":"2024-04-25 02:05:47.019471","last_unstale":"2024-04-25 02:05:47.352989","last_undegraded":"2024-04-25 02:05:47.352989","last_fullsized":"2024-04-25 02:05:47.352989","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389192","last_change":"2024-04-25 02:05:47.380774","last_active":"2024-04-25 02:05:47.389192","last_peered":"2024-04-25 02:05:47.389192","last_clean":"2024-04-25 02:05:47.389192","last_became_active":"2024-04-25 02:05:47.380517","last_became_peered":"2024-04-25 02:05:47.380517","last_unstale":"2024-04-25 02:05:47.389192","last_undegraded":"2024-04-25 02:05:47.389192","last_fullsized":"2024-04-25 02:05:47.389192","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352014","last_change":"2024-04-25 02:05:47.005189","last_active":"2024-04-25 02:05:47.352014","last_peered":"2024-04-25 02:05:47.352014","last_clean":"2024-04-25 02:05:47.352014","last_became_active":"2024-04-25 02:05:47.004657","last_became_peered":"2024-04-25 02:05:47.004657","last_unstale":"2024-04-25 02:05:47.352014","last_undegraded":"2024-04-25 02:05:47.352014","last_fullsized":"2024-04-25 02:05:47.352014","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388617","last_change":"2024-04-25 02:05:47.377256","last_active":"2024-04-25 02:05:47.388617","last_peered":"2024-04-25 02:05:47.388617","last_clean":"2024-04-25 02:05:47.388617","last_became_active":"2024-04-25 02:05:47.376589","last_became_peered":"2024-04-25 02:05:47.376589","last_unstale":"2024-04-25 02:05:47.388617","last_undegraded":"2024-04-25 02:05:47.388617","last_fullsized":"2024-04-25 02:05:47.388617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359016","last_change":"2024-04-25 02:05:46.994018","last_active":"2024-04-25 02:05:47.359016","last_peered":"2024-04-25 02:05:47.359016","last_clean":"2024-04-25 02:05:47.359016","last_became_active":"2024-04-25 02:05:46.993698","last_became_peered":"2024-04-25 02:05:46.993698","last_unstale":"2024-04-25 02:05:47.359016","last_undegraded":"2024-04-25 02:05:47.359016","last_fullsized":"2024-04-25 02:05:47.359016","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389233","last_change":"2024-04-25 02:05:47.382653","last_active":"2024-04-25 02:05:47.389233","last_peered":"2024-04-25 02:05:47.389233","last_clean":"2024-04-25 02:05:47.389233","last_became_active":"2024-04-25 02:05:47.382376","last_became_peered":"2024-04-25 02:05:47.382376","last_unstale":"2024-04-25 02:05:47.389233","last_undegraded":"2024-04-25 02:05:47.389233","last_fullsized":"2024-04-25 02:05:47.389233","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352520","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:05:47.352520","last_peered":"2024-04-25 02:05:47.352520","last_clean":"2024-04-25 02:05:47.352520","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:05:47.352520","last_undegraded":"2024-04-25 02:05:47.352520","last_fullsized":"2024-04-25 02:05:47.352520","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353532","last_change":"2024-04-25 02:05:47.001851","last_active":"2024-04-25 02:05:47.353532","last_peered":"2024-04-25 02:05:47.353532","last_clean":"2024-04-25 02:05:47.353532","last_became_active":"2024-04-25 02:05:47.001503","last_became_peered":"2024-04-25 02:05:47.001503","last_unstale":"2024-04-25 02:05:47.353532","last_undegraded":"2024-04-25 02:05:47.353532","last_fullsized":"2024-04-25 02:05:47.353532","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384277","last_change":"2024-04-25 02:05:47.378248","last_active":"2024-04-25 02:05:47.384277","last_peered":"2024-04-25 02:05:47.384277","last_clean":"2024-04-25 02:05:47.384277","last_became_active":"2024-04-25 02:05:47.377943","last_became_peered":"2024-04-25 02:05:47.377943","last_unstale":"2024-04-25 02:05:47.384277","last_undegraded":"2024-04-25 02:05:47.384277","last_fullsized":"2024-04-25 02:05:47.384277","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360052","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:05:47.360052","last_peered":"2024-04-25 02:05:47.360052","last_clean":"2024-04-25 02:05:47.360052","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:05:47.360052","last_undegraded":"2024-04-25 02:05:47.360052","last_fullsized":"2024-04-25 02:05:47.360052","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388406","last_change":"2024-04-25 02:05:47.021725","last_active":"2024-04-25 02:05:47.388406","last_peered":"2024-04-25 02:05:47.388406","last_clean":"2024-04-25 02:05:47.388406","last_became_active":"2024-04-25 02:05:47.021378","last_became_peered":"2024-04-25 02:05:47.021378","last_unstale":"2024-04-25 02:05:47.388406","last_undegraded":"2024-04-25 02:05:47.388406","last_fullsized":"2024-04-25 02:05:47.388406","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352584","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:05:47.352584","last_peered":"2024-04-25 02:05:47.352584","last_clean":"2024-04-25 02:05:47.352584","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:05:47.352584","last_undegraded":"2024-04-25 02:05:47.352584","last_fullsized":"2024-04-25 02:05:47.352584","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356151","last_change":"2024-04-25 02:05:47.028109","last_active":"2024-04-25 02:05:47.356151","last_peered":"2024-04-25 02:05:47.356151","last_clean":"2024-04-25 02:05:47.356151","last_became_active":"2024-04-25 02:05:47.026998","last_became_peered":"2024-04-25 02:05:47.026998","last_unstale":"2024-04-25 02:05:47.356151","last_undegraded":"2024-04-25 02:05:47.356151","last_fullsized":"2024-04-25 02:05:47.356151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388917","last_change":"2024-04-25 02:05:47.384104","last_active":"2024-04-25 02:05:47.388917","last_peered":"2024-04-25 02:05:47.388917","last_clean":"2024-04-25 02:05:47.388917","last_became_active":"2024-04-25 02:05:47.383783","last_became_peered":"2024-04-25 02:05:47.383783","last_unstale":"2024-04-25 02:05:47.388917","last_undegraded":"2024-04-25 02:05:47.388917","last_fullsized":"2024-04-25 02:05:47.388917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360990","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:05:47.360990","last_peered":"2024-04-25 02:05:47.360990","last_clean":"2024-04-25 02:05:47.360990","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:05:47.360990","last_undegraded":"2024-04-25 02:05:47.360990","last_fullsized":"2024-04-25 02:05:47.360990","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351208","last_change":"2024-04-25 02:05:47.013050","last_active":"2024-04-25 02:05:47.351208","last_peered":"2024-04-25 02:05:47.351208","last_clean":"2024-04-25 02:05:47.351208","last_became_active":"2024-04-25 02:05:47.012558","last_became_peered":"2024-04-25 02:05:47.012558","last_unstale":"2024-04-25 02:05:47.351208","last_undegraded":"2024-04-25 02:05:47.351208","last_fullsized":"2024-04-25 02:05:47.351208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373782","last_change":"2024-04-25 02:05:47.363093","last_active":"2024-04-25 02:05:47.373782","last_peered":"2024-04-25 02:05:47.373782","last_clean":"2024-04-25 02:05:47.373782","last_became_active":"2024-04-25 02:05:47.362753","last_became_peered":"2024-04-25 02:05:47.362753","last_unstale":"2024-04-25 02:05:47.373782","last_undegraded":"2024-04-25 02:05:47.373782","last_fullsized":"2024-04-25 02:05:47.373782","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352385","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:05:47.352385","last_peered":"2024-04-25 02:05:47.352385","last_clean":"2024-04-25 02:05:47.352385","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:05:47.352385","last_undegraded":"2024-04-25 02:05:47.352385","last_fullsized":"2024-04-25 02:05:47.352385","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356625","last_change":"2024-04-25 02:05:47.018087","last_active":"2024-04-25 02:05:47.356625","last_peered":"2024-04-25 02:05:47.356625","last_clean":"2024-04-25 02:05:47.356625","last_became_active":"2024-04-25 02:05:47.017799","last_became_peered":"2024-04-25 02:05:47.017799","last_unstale":"2024-04-25 02:05:47.356625","last_undegraded":"2024-04-25 02:05:47.356625","last_fullsized":"2024-04-25 02:05:47.356625","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387244","last_change":"2024-04-25 02:05:47.375657","last_active":"2024-04-25 02:05:47.387244","last_peered":"2024-04-25 02:05:47.387244","last_clean":"2024-04-25 02:05:47.387244","last_became_active":"2024-04-25 02:05:47.375334","last_became_peered":"2024-04-25 02:05:47.375334","last_unstale":"2024-04-25 02:05:47.387244","last_undegraded":"2024-04-25 02:05:47.387244","last_fullsized":"2024-04-25 02:05:47.387244","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357499","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:05:47.357499","last_peered":"2024-04-25 02:05:47.357499","last_clean":"2024-04-25 02:05:47.357499","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:05:47.357499","last_undegraded":"2024-04-25 02:05:47.357499","last_fullsized":"2024-04-25 02:05:47.357499","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358000","last_change":"2024-04-25 02:05:47.029097","last_active":"2024-04-25 02:05:47.358000","last_peered":"2024-04-25 02:05:47.358000","last_clean":"2024-04-25 02:05:47.358000","last_became_active":"2024-04-25 02:05:47.025880","last_became_peered":"2024-04-25 02:05:47.025880","last_unstale":"2024-04-25 02:05:47.358000","last_undegraded":"2024-04-25 02:05:47.358000","last_fullsized":"2024-04-25 02:05:47.358000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390611","last_change":"2024-04-25 02:05:47.384976","last_active":"2024-04-25 02:05:47.390611","last_peered":"2024-04-25 02:05:47.390611","last_clean":"2024-04-25 02:05:47.390611","last_became_active":"2024-04-25 02:05:47.384672","last_became_peered":"2024-04-25 02:05:47.384672","last_unstale":"2024-04-25 02:05:47.390611","last_undegraded":"2024-04-25 02:05:47.390611","last_fullsized":"2024-04-25 02:05:47.390611","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360865","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:05:47.360865","last_peered":"2024-04-25 02:05:47.360865","last_clean":"2024-04-25 02:05:47.360865","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:05:47.360865","last_undegraded":"2024-04-25 02:05:47.360865","last_fullsized":"2024-04-25 02:05:47.360865","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359901","last_change":"2024-04-25 02:05:47.026109","last_active":"2024-04-25 02:05:47.359901","last_peered":"2024-04-25 02:05:47.359901","last_clean":"2024-04-25 02:05:47.359901","last_became_active":"2024-04-25 02:05:47.025764","last_became_peered":"2024-04-25 02:05:47.025764","last_unstale":"2024-04-25 02:05:47.359901","last_undegraded":"2024-04-25 02:05:47.359901","last_fullsized":"2024-04-25 02:05:47.359901","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382178","last_change":"2024-04-25 02:05:47.377843","last_active":"2024-04-25 02:05:47.382178","last_peered":"2024-04-25 02:05:47.382178","last_clean":"2024-04-25 02:05:47.382178","last_became_active":"2024-04-25 02:05:47.377538","last_became_peered":"2024-04-25 02:05:47.377538","last_unstale":"2024-04-25 02:05:47.382178","last_undegraded":"2024-04-25 02:05:47.382178","last_fullsized":"2024-04-25 02:05:47.382178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352612","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:05:47.352612","last_peered":"2024-04-25 02:05:47.352612","last_clean":"2024-04-25 02:05:47.352612","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:05:47.352612","last_undegraded":"2024-04-25 02:05:47.352612","last_fullsized":"2024-04-25 02:05:47.352612","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354313","last_change":"2024-04-25 02:05:47.004781","last_active":"2024-04-25 02:05:47.354313","last_peered":"2024-04-25 02:05:47.354313","last_clean":"2024-04-25 02:05:47.354313","last_became_active":"2024-04-25 02:05:47.004453","last_became_peered":"2024-04-25 02:05:47.004453","last_unstale":"2024-04-25 02:05:47.354313","last_undegraded":"2024-04-25 02:05:47.354313","last_fullsized":"2024-04-25 02:05:47.354313","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380248","last_change":"2024-04-25 02:05:47.376611","last_active":"2024-04-25 02:05:47.380248","last_peered":"2024-04-25 02:05:47.380248","last_clean":"2024-04-25 02:05:47.380248","last_became_active":"2024-04-25 02:05:47.376284","last_became_peered":"2024-04-25 02:05:47.376284","last_unstale":"2024-04-25 02:05:47.380248","last_undegraded":"2024-04-25 02:05:47.380248","last_fullsized":"2024-04-25 02:05:47.380248","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389945","last_change":"2024-04-25 02:05:47.387545","last_active":"2024-04-25 02:05:47.389945","last_peered":"2024-04-25 02:05:47.389945","last_clean":"2024-04-25 02:05:47.389945","last_became_active":"2024-04-25 02:05:47.387246","last_became_peered":"2024-04-25 02:05:47.387246","last_unstale":"2024-04-25 02:05:47.389945","last_undegraded":"2024-04-25 02:05:47.389945","last_fullsized":"2024-04-25 02:05:47.389945","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361706","last_change":"2024-04-25 02:05:47.006606","last_active":"2024-04-25 02:05:47.361706","last_peered":"2024-04-25 02:05:47.361706","last_clean":"2024-04-25 02:05:47.361706","last_became_active":"2024-04-25 02:05:47.006296","last_became_peered":"2024-04-25 02:05:47.006296","last_unstale":"2024-04-25 02:05:47.361706","last_undegraded":"2024-04-25 02:05:47.361706","last_fullsized":"2024-04-25 02:05:47.361706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387972","last_change":"2024-04-25 02:05:47.381933","last_active":"2024-04-25 02:05:47.387972","last_peered":"2024-04-25 02:05:47.387972","last_clean":"2024-04-25 02:05:47.387972","last_became_active":"2024-04-25 02:05:47.379588","last_became_peered":"2024-04-25 02:05:47.379588","last_unstale":"2024-04-25 02:05:47.387972","last_undegraded":"2024-04-25 02:05:47.387972","last_fullsized":"2024-04-25 02:05:47.387972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378078","last_change":"2024-04-25 02:05:47.008840","last_active":"2024-04-25 02:05:47.378078","last_peered":"2024-04-25 02:05:47.378078","last_clean":"2024-04-25 02:05:47.378078","last_became_active":"2024-04-25 02:05:47.008521","last_became_peered":"2024-04-25 02:05:47.008521","last_unstale":"2024-04-25 02:05:47.378078","last_undegraded":"2024-04-25 02:05:47.378078","last_fullsized":"2024-04-25 02:05:47.378078","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385090","last_change":"2024-04-25 02:05:47.378449","last_active":"2024-04-25 02:05:47.385090","last_peered":"2024-04-25 02:05:47.385090","last_clean":"2024-04-25 02:05:47.385090","last_became_active":"2024-04-25 02:05:47.371394","last_became_peered":"2024-04-25 02:05:47.371394","last_unstale":"2024-04-25 02:05:47.385090","last_undegraded":"2024-04-25 02:05:47.385090","last_fullsized":"2024-04-25 02:05:47.385090","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389698","last_change":"2024-04-25 02:05:47.021735","last_active":"2024-04-25 02:05:47.389698","last_peered":"2024-04-25 02:05:47.389698","last_clean":"2024-04-25 02:05:47.389698","last_became_active":"2024-04-25 02:05:47.021400","last_became_peered":"2024-04-25 02:05:47.021400","last_unstale":"2024-04-25 02:05:47.389698","last_undegraded":"2024-04-25 02:05:47.389698","last_fullsized":"2024-04-25 02:05:47.389698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389987","last_change":"2024-04-25 02:05:47.383033","last_active":"2024-04-25 02:05:47.389987","last_peered":"2024-04-25 02:05:47.389987","last_clean":"2024-04-25 02:05:47.389987","last_became_active":"2024-04-25 02:05:47.382717","last_became_peered":"2024-04-25 02:05:47.382717","last_unstale":"2024-04-25 02:05:47.389987","last_undegraded":"2024-04-25 02:05:47.389987","last_fullsized":"2024-04-25 02:05:47.389987","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389376","last_change":"2024-04-25 02:05:47.014112","last_active":"2024-04-25 02:05:47.389376","last_peered":"2024-04-25 02:05:47.389376","last_clean":"2024-04-25 02:05:47.389376","last_became_active":"2024-04-25 02:05:47.013624","last_became_peered":"2024-04-25 02:05:47.013624","last_unstale":"2024-04-25 02:05:47.389376","last_undegraded":"2024-04-25 02:05:47.389376","last_fullsized":"2024-04-25 02:05:47.389376","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380606","last_change":"2024-04-25 02:05:47.373843","last_active":"2024-04-25 02:05:47.380606","last_peered":"2024-04-25 02:05:47.380606","last_clean":"2024-04-25 02:05:47.380606","last_became_active":"2024-04-25 02:05:47.369284","last_became_peered":"2024-04-25 02:05:47.369284","last_unstale":"2024-04-25 02:05:47.380606","last_undegraded":"2024-04-25 02:05:47.380606","last_fullsized":"2024-04-25 02:05:47.380606","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356604","last_change":"2024-04-25 02:05:47.028330","last_active":"2024-04-25 02:05:47.356604","last_peered":"2024-04-25 02:05:47.356604","last_clean":"2024-04-25 02:05:47.356604","last_became_active":"2024-04-25 02:05:47.027257","last_became_peered":"2024-04-25 02:05:47.027257","last_unstale":"2024-04-25 02:05:47.356604","last_undegraded":"2024-04-25 02:05:47.356604","last_fullsized":"2024-04-25 02:05:47.356604","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.375879","last_change":"2024-04-25 02:05:47.366400","last_active":"2024-04-25 02:05:47.375879","last_peered":"2024-04-25 02:05:47.375879","last_clean":"2024-04-25 02:05:47.375879","last_became_active":"2024-04-25 02:05:47.366000","last_became_peered":"2024-04-25 02:05:47.366000","last_unstale":"2024-04-25 02:05:47.375879","last_undegraded":"2024-04-25 02:05:47.375879","last_fullsized":"2024-04-25 02:05:47.375879","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351200","last_change":"2024-04-25 02:05:46.999953","last_active":"2024-04-25 02:05:47.351200","last_peered":"2024-04-25 02:05:47.351200","last_clean":"2024-04-25 02:05:47.351200","last_became_active":"2024-04-25 02:05:46.999606","last_became_peered":"2024-04-25 02:05:46.999606","last_unstale":"2024-04-25 02:05:47.351200","last_undegraded":"2024-04-25 02:05:47.351200","last_fullsized":"2024-04-25 02:05:47.351200","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387617","last_change":"2024-04-25 02:05:47.381525","last_active":"2024-04-25 02:05:47.387617","last_peered":"2024-04-25 02:05:47.387617","last_clean":"2024-04-25 02:05:47.387617","last_became_active":"2024-04-25 02:05:47.378390","last_became_peered":"2024-04-25 02:05:47.378390","last_unstale":"2024-04-25 02:05:47.387617","last_undegraded":"2024-04-25 02:05:47.387617","last_fullsized":"2024-04-25 02:05:47.387617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363760","last_change":"2024-04-25 02:05:47.026754","last_active":"2024-04-25 02:05:47.363760","last_peered":"2024-04-25 02:05:47.363760","last_clean":"2024-04-25 02:05:47.363760","last_became_active":"2024-04-25 02:05:47.026391","last_became_peered":"2024-04-25 02:05:47.026391","last_unstale":"2024-04-25 02:05:47.363760","last_undegraded":"2024-04-25 02:05:47.363760","last_fullsized":"2024-04-25 02:05:47.363760","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388695","last_change":"2024-04-25 02:05:47.379347","last_active":"2024-04-25 02:05:47.388695","last_peered":"2024-04-25 02:05:47.388695","last_clean":"2024-04-25 02:05:47.388695","last_became_active":"2024-04-25 02:05:47.379040","last_became_peered":"2024-04-25 02:05:47.379040","last_unstale":"2024-04-25 02:05:47.388695","last_undegraded":"2024-04-25 02:05:47.388695","last_fullsized":"2024-04-25 02:05:47.388695","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358961","last_change":"2024-04-25 02:05:47.027710","last_active":"2024-04-25 02:05:47.358961","last_peered":"2024-04-25 02:05:47.358961","last_clean":"2024-04-25 02:05:47.358961","last_became_active":"2024-04-25 02:05:47.027316","last_became_peered":"2024-04-25 02:05:47.027316","last_unstale":"2024-04-25 02:05:47.358961","last_undegraded":"2024-04-25 02:05:47.358961","last_fullsized":"2024-04-25 02:05:47.358961","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374780","last_change":"2024-04-25 02:05:47.372923","last_active":"2024-04-25 02:05:47.374780","last_peered":"2024-04-25 02:05:47.374780","last_clean":"2024-04-25 02:05:47.374780","last_became_active":"2024-04-25 02:05:47.372581","last_became_peered":"2024-04-25 02:05:47.372581","last_unstale":"2024-04-25 02:05:47.374780","last_undegraded":"2024-04-25 02:05:47.374780","last_fullsized":"2024-04-25 02:05:47.374780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354411","last_change":"2024-04-25 02:05:47.004609","last_active":"2024-04-25 02:05:47.354411","last_peered":"2024-04-25 02:05:47.354411","last_clean":"2024-04-25 02:05:47.354411","last_became_active":"2024-04-25 02:05:47.001832","last_became_peered":"2024-04-25 02:05:47.001832","last_unstale":"2024-04-25 02:05:47.354411","last_undegraded":"2024-04-25 02:05:47.354411","last_fullsized":"2024-04-25 02:05:47.354411","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390986","last_change":"2024-04-25 02:05:47.380256","last_active":"2024-04-25 02:05:47.390986","last_peered":"2024-04-25 02:05:47.390986","last_clean":"2024-04-25 02:05:47.390986","last_became_active":"2024-04-25 02:05:47.379963","last_became_peered":"2024-04-25 02:05:47.379963","last_unstale":"2024-04-25 02:05:47.390986","last_undegraded":"2024-04-25 02:05:47.390986","last_fullsized":"2024-04-25 02:05:47.390986","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352630","last_change":"2024-04-25 02:05:46.996348","last_active":"2024-04-25 02:05:47.352630","last_peered":"2024-04-25 02:05:47.352630","last_clean":"2024-04-25 02:05:47.352630","last_became_active":"2024-04-25 02:05:46.996069","last_became_peered":"2024-04-25 02:05:46.996069","last_unstale":"2024-04-25 02:05:47.352630","last_undegraded":"2024-04-25 02:05:47.352630","last_fullsized":"2024-04-25 02:05:47.352630","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389206","last_change":"2024-04-25 02:05:47.382589","last_active":"2024-04-25 02:05:47.389206","last_peered":"2024-04-25 02:05:47.389206","last_clean":"2024-04-25 02:05:47.389206","last_became_active":"2024-04-25 02:05:47.382307","last_became_peered":"2024-04-25 02:05:47.382307","last_unstale":"2024-04-25 02:05:47.389206","last_undegraded":"2024-04-25 02:05:47.389206","last_fullsized":"2024-04-25 02:05:47.389206","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-04-25 02:05:48.371682","last_change":"2024-04-25 02:05:46.999274","last_active":"2024-04-25 02:05:48.371682","last_peered":"2024-04-25 02:05:48.371682","last_clean":"2024-04-25 02:05:48.371682","last_became_active":"2024-04-25 02:05:46.998876","last_became_peered":"2024-04-25 02:05:46.998876","last_unstale":"2024-04-25 02:05:48.371682","last_undegraded":"2024-04-25 02:05:48.371682","last_fullsized":"2024-04-25 02:05:48.371682","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382025","last_change":"2024-04-25 02:05:47.377487","last_active":"2024-04-25 02:05:47.382025","last_peered":"2024-04-25 02:05:47.382025","last_clean":"2024-04-25 02:05:47.382025","last_became_active":"2024-04-25 02:05:47.376770","last_became_peered":"2024-04-25 02:05:47.376770","last_unstale":"2024-04-25 02:05:47.382025","last_undegraded":"2024-04-25 02:05:47.382025","last_fullsized":"2024-04-25 02:05:47.382025","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361361","last_change":"2024-04-25 02:05:47.026964","last_active":"2024-04-25 02:05:47.361361","last_peered":"2024-04-25 02:05:47.361361","last_clean":"2024-04-25 02:05:47.361361","last_became_active":"2024-04-25 02:05:47.026604","last_became_peered":"2024-04-25 02:05:47.026604","last_unstale":"2024-04-25 02:05:47.361361","last_undegraded":"2024-04-25 02:05:47.361361","last_fullsized":"2024-04-25 02:05:47.361361","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386703","last_change":"2024-04-25 02:05:47.375591","last_active":"2024-04-25 02:05:47.386703","last_peered":"2024-04-25 02:05:47.386703","last_clean":"2024-04-25 02:05:47.386703","last_became_active":"2024-04-25 02:05:47.375271","last_became_peered":"2024-04-25 02:05:47.375271","last_unstale":"2024-04-25 02:05:47.386703","last_undegraded":"2024-04-25 02:05:47.386703","last_fullsized":"2024-04-25 02:05:47.386703","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362340","last_change":"2024-04-25 02:05:47.028567","last_active":"2024-04-25 02:05:47.362340","last_peered":"2024-04-25 02:05:47.362340","last_clean":"2024-04-25 02:05:47.362340","last_became_active":"2024-04-25 02:05:47.027520","last_became_peered":"2024-04-25 02:05:47.027520","last_unstale":"2024-04-25 02:05:47.362340","last_undegraded":"2024-04-25 02:05:47.362340","last_fullsized":"2024-04-25 02:05:47.362340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387289","last_change":"2024-04-25 02:05:47.376362","last_active":"2024-04-25 02:05:47.387289","last_peered":"2024-04-25 02:05:47.387289","last_clean":"2024-04-25 02:05:47.387289","last_became_active":"2024-04-25 02:05:47.376045","last_became_peered":"2024-04-25 02:05:47.376045","last_unstale":"2024-04-25 02:05:47.387289","last_undegraded":"2024-04-25 02:05:47.387289","last_fullsized":"2024-04-25 02:05:47.387289","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351558","last_change":"2024-04-25 02:05:47.018376","last_active":"2024-04-25 02:05:47.351558","last_peered":"2024-04-25 02:05:47.351558","last_clean":"2024-04-25 02:05:47.351558","last_became_active":"2024-04-25 02:05:47.018044","last_became_peered":"2024-04-25 02:05:47.018044","last_unstale":"2024-04-25 02:05:47.351558","last_undegraded":"2024-04-25 02:05:47.351558","last_fullsized":"2024-04-25 02:05:47.351558","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389103","last_change":"2024-04-25 02:05:47.384783","last_active":"2024-04-25 02:05:47.389103","last_peered":"2024-04-25 02:05:47.389103","last_clean":"2024-04-25 02:05:47.389103","last_became_active":"2024-04-25 02:05:47.384440","last_became_peered":"2024-04-25 02:05:47.384440","last_unstale":"2024-04-25 02:05:47.389103","last_undegraded":"2024-04-25 02:05:47.389103","last_fullsized":"2024-04-25 02:05:47.389103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352883","last_change":"2024-04-25 02:05:47.000733","last_active":"2024-04-25 02:05:47.352883","last_peered":"2024-04-25 02:05:47.352883","last_clean":"2024-04-25 02:05:47.352883","last_became_active":"2024-04-25 02:05:47.000381","last_became_peered":"2024-04-25 02:05:47.000381","last_unstale":"2024-04-25 02:05:47.352883","last_undegraded":"2024-04-25 02:05:47.352883","last_fullsized":"2024-04-25 02:05:47.352883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372954","last_change":"2024-04-25 02:05:47.363717","last_active":"2024-04-25 02:05:47.372954","last_peered":"2024-04-25 02:05:47.372954","last_clean":"2024-04-25 02:05:47.372954","last_became_active":"2024-04-25 02:05:47.363378","last_became_peered":"2024-04-25 02:05:47.363378","last_unstale":"2024-04-25 02:05:47.372954","last_undegraded":"2024-04-25 02:05:47.372954","last_fullsized":"2024-04-25 02:05:47.372954","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377804","last_change":"2024-04-25 02:05:46.996992","last_active":"2024-04-25 02:05:47.377804","last_peered":"2024-04-25 02:05:47.377804","last_clean":"2024-04-25 02:05:47.377804","last_became_active":"2024-04-25 02:05:46.996648","last_became_peered":"2024-04-25 02:05:46.996648","last_unstale":"2024-04-25 02:05:47.377804","last_undegraded":"2024-04-25 02:05:47.377804","last_fullsized":"2024-04-25 02:05:47.377804","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389212","last_change":"2024-04-25 02:05:47.380340","last_active":"2024-04-25 02:05:47.389212","last_peered":"2024-04-25 02:05:47.389212","last_clean":"2024-04-25 02:05:47.389212","last_became_active":"2024-04-25 02:05:47.380051","last_became_peered":"2024-04-25 02:05:47.380051","last_unstale":"2024-04-25 02:05:47.389212","last_undegraded":"2024-04-25 02:05:47.389212","last_fullsized":"2024-04-25 02:05:47.389212","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351619","last_change":"2024-04-25 02:05:46.999913","last_active":"2024-04-25 02:05:47.351619","last_peered":"2024-04-25 02:05:47.351619","last_clean":"2024-04-25 02:05:47.351619","last_became_active":"2024-04-25 02:05:46.999553","last_became_peered":"2024-04-25 02:05:46.999553","last_unstale":"2024-04-25 02:05:47.351619","last_undegraded":"2024-04-25 02:05:47.351619","last_fullsized":"2024-04-25 02:05:47.351619","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384258","last_change":"2024-04-25 02:05:47.377775","last_active":"2024-04-25 02:05:47.384258","last_peered":"2024-04-25 02:05:47.384258","last_clean":"2024-04-25 02:05:47.384258","last_became_active":"2024-04-25 02:05:47.377456","last_became_peered":"2024-04-25 02:05:47.377456","last_unstale":"2024-04-25 02:05:47.384258","last_undegraded":"2024-04-25 02:05:47.384258","last_fullsized":"2024-04-25 02:05:47.384258","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389886","last_change":"2024-04-25 02:05:47.022408","last_active":"2024-04-25 02:05:47.389886","last_peered":"2024-04-25 02:05:47.389886","last_clean":"2024-04-25 02:05:47.389886","last_became_active":"2024-04-25 02:05:47.022145","last_became_peered":"2024-04-25 02:05:47.022145","last_unstale":"2024-04-25 02:05:47.389886","last_undegraded":"2024-04-25 02:05:47.389886","last_fullsized":"2024-04-25 02:05:47.389886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389273","last_change":"2024-04-25 02:05:47.383157","last_active":"2024-04-25 02:05:47.389273","last_peered":"2024-04-25 02:05:47.389273","last_clean":"2024-04-25 02:05:47.389273","last_became_active":"2024-04-25 02:05:47.382824","last_became_peered":"2024-04-25 02:05:47.382824","last_unstale":"2024-04-25 02:05:47.389273","last_undegraded":"2024-04-25 02:05:47.389273","last_fullsized":"2024-04-25 02:05:47.389273","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353638","last_change":"2024-04-25 02:05:46.999652","last_active":"2024-04-25 02:05:47.353638","last_peered":"2024-04-25 02:05:47.353638","last_clean":"2024-04-25 02:05:47.353638","last_became_active":"2024-04-25 02:05:46.999330","last_became_peered":"2024-04-25 02:05:46.999330","last_unstale":"2024-04-25 02:05:47.353638","last_undegraded":"2024-04-25 02:05:47.353638","last_fullsized":"2024-04-25 02:05:47.353638","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382043","last_change":"2024-04-25 02:05:47.377666","last_active":"2024-04-25 02:05:47.382043","last_peered":"2024-04-25 02:05:47.382043","last_clean":"2024-04-25 02:05:47.382043","last_became_active":"2024-04-25 02:05:47.376996","last_became_peered":"2024-04-25 02:05:47.376996","last_unstale":"2024-04-25 02:05:47.382043","last_undegraded":"2024-04-25 02:05:47.382043","last_fullsized":"2024-04-25 02:05:47.382043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361467","last_change":"2024-04-25 02:05:47.026476","last_active":"2024-04-25 02:05:47.361467","last_peered":"2024-04-25 02:05:47.361467","last_clean":"2024-04-25 02:05:47.361467","last_became_active":"2024-04-25 02:05:47.025938","last_became_peered":"2024-04-25 02:05:47.025938","last_unstale":"2024-04-25 02:05:47.361467","last_undegraded":"2024-04-25 02:05:47.361467","last_fullsized":"2024-04-25 02:05:47.361467","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373149","last_change":"2024-04-25 02:05:47.368468","last_active":"2024-04-25 02:05:47.373149","last_peered":"2024-04-25 02:05:47.373149","last_clean":"2024-04-25 02:05:47.373149","last_became_active":"2024-04-25 02:05:47.368132","last_became_peered":"2024-04-25 02:05:47.368132","last_unstale":"2024-04-25 02:05:47.373149","last_undegraded":"2024-04-25 02:05:47.373149","last_fullsized":"2024-04-25 02:05:47.373149","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388094","last_change":"2024-04-25 02:05:47.009725","last_active":"2024-04-25 02:05:47.388094","last_peered":"2024-04-25 02:05:47.388094","last_clean":"2024-04-25 02:05:47.388094","last_became_active":"2024-04-25 02:05:47.007964","last_became_peered":"2024-04-25 02:05:47.007964","last_unstale":"2024-04-25 02:05:47.388094","last_undegraded":"2024-04-25 02:05:47.388094","last_fullsized":"2024-04-25 02:05:47.388094","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388711","last_change":"2024-04-25 02:05:47.379616","last_active":"2024-04-25 02:05:47.388711","last_peered":"2024-04-25 02:05:47.388711","last_clean":"2024-04-25 02:05:47.388711","last_became_active":"2024-04-25 02:05:47.379103","last_became_peered":"2024-04-25 02:05:47.379103","last_unstale":"2024-04-25 02:05:47.388711","last_undegraded":"2024-04-25 02:05:47.388711","last_fullsized":"2024-04-25 02:05:47.388711","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360333","last_change":"2024-04-25 02:05:47.009452","last_active":"2024-04-25 02:05:47.360333","last_peered":"2024-04-25 02:05:47.360333","last_clean":"2024-04-25 02:05:47.360333","last_became_active":"2024-04-25 02:05:47.009116","last_became_peered":"2024-04-25 02:05:47.009116","last_unstale":"2024-04-25 02:05:47.360333","last_undegraded":"2024-04-25 02:05:47.360333","last_fullsized":"2024-04-25 02:05:47.360333","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389963","last_change":"2024-04-25 02:05:47.386054","last_active":"2024-04-25 02:05:47.389963","last_peered":"2024-04-25 02:05:47.389963","last_clean":"2024-04-25 02:05:47.389963","last_became_active":"2024-04-25 02:05:47.383311","last_became_peered":"2024-04-25 02:05:47.383311","last_unstale":"2024-04-25 02:05:47.389963","last_undegraded":"2024-04-25 02:05:47.389963","last_fullsized":"2024-04-25 02:05:47.389963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351815","last_change":"2024-04-25 02:05:47.020004","last_active":"2024-04-25 02:05:47.351815","last_peered":"2024-04-25 02:05:47.351815","last_clean":"2024-04-25 02:05:47.351815","last_became_active":"2024-04-25 02:05:47.019687","last_became_peered":"2024-04-25 02:05:47.019687","last_unstale":"2024-04-25 02:05:47.351815","last_undegraded":"2024-04-25 02:05:47.351815","last_fullsized":"2024-04-25 02:05:47.351815","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377719","last_change":"2024-04-25 02:05:47.365437","last_active":"2024-04-25 02:05:47.377719","last_peered":"2024-04-25 02:05:47.377719","last_clean":"2024-04-25 02:05:47.377719","last_became_active":"2024-04-25 02:05:47.365101","last_became_peered":"2024-04-25 02:05:47.365101","last_unstale":"2024-04-25 02:05:47.377719","last_undegraded":"2024-04-25 02:05:47.377719","last_fullsized":"2024-04-25 02:05:47.377719","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374047","last_change":"2024-04-25 02:05:46.993531","last_active":"2024-04-25 02:05:47.374047","last_peered":"2024-04-25 02:05:47.374047","last_clean":"2024-04-25 02:05:47.374047","last_became_active":"2024-04-25 02:05:46.993117","last_became_peered":"2024-04-25 02:05:46.993117","last_unstale":"2024-04-25 02:05:47.374047","last_undegraded":"2024-04-25 02:05:47.374047","last_fullsized":"2024-04-25 02:05:47.374047","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390894","last_change":"2024-04-25 02:05:47.385729","last_active":"2024-04-25 02:05:47.390894","last_peered":"2024-04-25 02:05:47.390894","last_clean":"2024-04-25 02:05:47.390894","last_became_active":"2024-04-25 02:05:47.385421","last_became_peered":"2024-04-25 02:05:47.385421","last_unstale":"2024-04-25 02:05:47.390894","last_undegraded":"2024-04-25 02:05:47.390894","last_fullsized":"2024-04-25 02:05:47.390894","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391988","last_change":"2024-04-25 02:05:47.020323","last_active":"2024-04-25 02:05:47.391988","last_peered":"2024-04-25 02:05:47.391988","last_clean":"2024-04-25 02:05:47.391988","last_became_active":"2024-04-25 02:05:47.019973","last_became_peered":"2024-04-25 02:05:47.019973","last_unstale":"2024-04-25 02:05:47.391988","last_undegraded":"2024-04-25 02:05:47.391988","last_fullsized":"2024-04-25 02:05:47.391988","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384226","last_change":"2024-04-25 02:05:47.375256","last_active":"2024-04-25 02:05:47.384226","last_peered":"2024-04-25 02:05:47.384226","last_clean":"2024-04-25 02:05:47.384226","last_became_active":"2024-04-25 02:05:47.374920","last_became_peered":"2024-04-25 02:05:47.374920","last_unstale":"2024-04-25 02:05:47.384226","last_undegraded":"2024-04-25 02:05:47.384226","last_fullsized":"2024-04-25 02:05:47.384226","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353210","last_change":"2024-04-25 02:05:46.995620","last_active":"2024-04-25 02:05:47.353210","last_peered":"2024-04-25 02:05:47.353210","last_clean":"2024-04-25 02:05:47.353210","last_became_active":"2024-04-25 02:05:46.995117","last_became_peered":"2024-04-25 02:05:46.995117","last_unstale":"2024-04-25 02:05:47.353210","last_undegraded":"2024-04-25 02:05:47.353210","last_fullsized":"2024-04-25 02:05:47.353210","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374027","last_change":"2024-04-25 02:05:47.372331","last_active":"2024-04-25 02:05:47.374027","last_peered":"2024-04-25 02:05:47.374027","last_clean":"2024-04-25 02:05:47.374027","last_became_active":"2024-04-25 02:05:47.372004","last_became_peered":"2024-04-25 02:05:47.372004","last_unstale":"2024-04-25 02:05:47.374027","last_undegraded":"2024-04-25 02:05:47.374027","last_fullsized":"2024-04-25 02:05:47.374027","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353418","last_change":"2024-04-25 02:05:46.999650","last_active":"2024-04-25 02:05:47.353418","last_peered":"2024-04-25 02:05:47.353418","last_clean":"2024-04-25 02:05:47.353418","last_became_active":"2024-04-25 02:05:46.999284","last_became_peered":"2024-04-25 02:05:46.999284","last_unstale":"2024-04-25 02:05:47.353418","last_undegraded":"2024-04-25 02:05:47.353418","last_fullsized":"2024-04-25 02:05:47.353418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386278","last_change":"2024-04-25 02:05:47.380781","last_active":"2024-04-25 02:05:47.386278","last_peered":"2024-04-25 02:05:47.386278","last_clean":"2024-04-25 02:05:47.386278","last_became_active":"2024-04-25 02:05:47.380462","last_became_peered":"2024-04-25 02:05:47.380462","last_unstale":"2024-04-25 02:05:47.386278","last_undegraded":"2024-04-25 02:05:47.386278","last_fullsized":"2024-04-25 02:05:47.386278","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362868","last_change":"2024-04-25 02:05:47.001836","last_active":"2024-04-25 02:05:47.362868","last_peered":"2024-04-25 02:05:47.362868","last_clean":"2024-04-25 02:05:47.362868","last_became_active":"2024-04-25 02:05:47.001509","last_became_peered":"2024-04-25 02:05:47.001509","last_unstale":"2024-04-25 02:05:47.362868","last_undegraded":"2024-04-25 02:05:47.362868","last_fullsized":"2024-04-25 02:05:47.362868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383697","last_change":"2024-04-25 02:05:47.373785","last_active":"2024-04-25 02:05:47.383697","last_peered":"2024-04-25 02:05:47.383697","last_clean":"2024-04-25 02:05:47.383697","last_became_active":"2024-04-25 02:05:47.371646","last_became_peered":"2024-04-25 02:05:47.371646","last_unstale":"2024-04-25 02:05:47.383697","last_undegraded":"2024-04-25 02:05:47.383697","last_fullsized":"2024-04-25 02:05:47.383697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359221","last_change":"2024-04-25 02:05:47.009028","last_active":"2024-04-25 02:05:47.359221","last_peered":"2024-04-25 02:05:47.359221","last_clean":"2024-04-25 02:05:47.359221","last_became_active":"2024-04-25 02:05:47.007728","last_became_peered":"2024-04-25 02:05:47.007728","last_unstale":"2024-04-25 02:05:47.359221","last_undegraded":"2024-04-25 02:05:47.359221","last_fullsized":"2024-04-25 02:05:47.359221","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390062","last_change":"2024-04-25 02:05:47.386599","last_active":"2024-04-25 02:05:47.390062","last_peered":"2024-04-25 02:05:47.390062","last_clean":"2024-04-25 02:05:47.390062","last_became_active":"2024-04-25 02:05:47.383052","last_became_peered":"2024-04-25 02:05:47.383052","last_unstale":"2024-04-25 02:05:47.390062","last_undegraded":"2024-04-25 02:05:47.390062","last_fullsized":"2024-04-25 02:05:47.390062","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351457","last_change":"2024-04-25 02:05:46.992970","last_active":"2024-04-25 02:05:47.351457","last_peered":"2024-04-25 02:05:47.351457","last_clean":"2024-04-25 02:05:47.351457","last_became_active":"2024-04-25 02:05:46.992580","last_became_peered":"2024-04-25 02:05:46.992580","last_unstale":"2024-04-25 02:05:47.351457","last_undegraded":"2024-04-25 02:05:47.351457","last_fullsized":"2024-04-25 02:05:47.351457","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390594","last_change":"2024-04-25 02:05:47.384947","last_active":"2024-04-25 02:05:47.390594","last_peered":"2024-04-25 02:05:47.390594","last_clean":"2024-04-25 02:05:47.390594","last_became_active":"2024-04-25 02:05:47.384477","last_became_peered":"2024-04-25 02:05:47.384477","last_unstale":"2024-04-25 02:05:47.390594","last_undegraded":"2024-04-25 02:05:47.390594","last_fullsized":"2024-04-25 02:05:47.390594","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390564","last_change":"2024-04-25 02:05:47.016029","last_active":"2024-04-25 02:05:47.390564","last_peered":"2024-04-25 02:05:47.390564","last_clean":"2024-04-25 02:05:47.390564","last_became_active":"2024-04-25 02:05:47.015470","last_became_peered":"2024-04-25 02:05:47.015470","last_unstale":"2024-04-25 02:05:47.390564","last_undegraded":"2024-04-25 02:05:47.390564","last_fullsized":"2024-04-25 02:05:47.390564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377970","last_change":"2024-04-25 02:05:47.368583","last_active":"2024-04-25 02:05:47.377970","last_peered":"2024-04-25 02:05:47.377970","last_clean":"2024-04-25 02:05:47.377970","last_became_active":"2024-04-25 02:05:47.366798","last_became_peered":"2024-04-25 02:05:47.366798","last_unstale":"2024-04-25 02:05:47.377970","last_undegraded":"2024-04-25 02:05:47.377970","last_fullsized":"2024-04-25 02:05:47.377970","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388229","last_change":"2024-04-25 02:05:47.005838","last_active":"2024-04-25 02:05:47.388229","last_peered":"2024-04-25 02:05:47.388229","last_clean":"2024-04-25 02:05:47.388229","last_became_active":"2024-04-25 02:05:47.005500","last_became_peered":"2024-04-25 02:05:47.005500","last_unstale":"2024-04-25 02:05:47.388229","last_undegraded":"2024-04-25 02:05:47.388229","last_fullsized":"2024-04-25 02:05:47.388229","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386313","last_change":"2024-04-25 02:05:47.380789","last_active":"2024-04-25 02:05:47.386313","last_peered":"2024-04-25 02:05:47.386313","last_clean":"2024-04-25 02:05:47.386313","last_became_active":"2024-04-25 02:05:47.380537","last_became_peered":"2024-04-25 02:05:47.380537","last_unstale":"2024-04-25 02:05:47.386313","last_undegraded":"2024-04-25 02:05:47.386313","last_fullsized":"2024-04-25 02:05:47.386313","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388104","last_change":"2024-04-25 02:05:47.006598","last_active":"2024-04-25 02:05:47.388104","last_peered":"2024-04-25 02:05:47.388104","last_clean":"2024-04-25 02:05:47.388104","last_became_active":"2024-04-25 02:05:47.006139","last_became_peered":"2024-04-25 02:05:47.006139","last_unstale":"2024-04-25 02:05:47.388104","last_undegraded":"2024-04-25 02:05:47.388104","last_fullsized":"2024-04-25 02:05:47.388104","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378165","last_change":"2024-04-25 02:05:47.374238","last_active":"2024-04-25 02:05:47.378165","last_peered":"2024-04-25 02:05:47.378165","last_clean":"2024-04-25 02:05:47.378165","last_became_active":"2024-04-25 02:05:47.373927","last_became_peered":"2024-04-25 02:05:47.373927","last_unstale":"2024-04-25 02:05:47.378165","last_undegraded":"2024-04-25 02:05:47.378165","last_fullsized":"2024-04-25 02:05:47.378165","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353045","last_change":"2024-04-25 02:05:47.003496","last_active":"2024-04-25 02:05:47.353045","last_peered":"2024-04-25 02:05:47.353045","last_clean":"2024-04-25 02:05:47.353045","last_became_active":"2024-04-25 02:05:47.002906","last_became_peered":"2024-04-25 02:05:47.002906","last_unstale":"2024-04-25 02:05:47.353045","last_undegraded":"2024-04-25 02:05:47.353045","last_fullsized":"2024-04-25 02:05:47.353045","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390790","last_change":"2024-04-25 02:05:47.385923","last_active":"2024-04-25 02:05:47.390790","last_peered":"2024-04-25 02:05:47.390790","last_clean":"2024-04-25 02:05:47.390790","last_became_active":"2024-04-25 02:05:47.385607","last_became_peered":"2024-04-25 02:05:47.385607","last_unstale":"2024-04-25 02:05:47.390790","last_undegraded":"2024-04-25 02:05:47.390790","last_fullsized":"2024-04-25 02:05:47.390790","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362831","last_change":"2024-04-25 02:05:46.999151","last_active":"2024-04-25 02:05:47.362831","last_peered":"2024-04-25 02:05:47.362831","last_clean":"2024-04-25 02:05:47.362831","last_became_active":"2024-04-25 02:05:46.998843","last_became_peered":"2024-04-25 02:05:46.998843","last_unstale":"2024-04-25 02:05:47.362831","last_undegraded":"2024-04-25 02:05:47.362831","last_fullsized":"2024-04-25 02:05:47.362831","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387468","last_change":"2024-04-25 02:05:47.381229","last_active":"2024-04-25 02:05:47.387468","last_peered":"2024-04-25 02:05:47.387468","last_clean":"2024-04-25 02:05:47.387468","last_became_active":"2024-04-25 02:05:47.380920","last_became_peered":"2024-04-25 02:05:47.380920","last_unstale":"2024-04-25 02:05:47.387468","last_undegraded":"2024-04-25 02:05:47.387468","last_fullsized":"2024-04-25 02:05:47.387468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385052","last_change":"2024-04-25 02:05:47.002796","last_active":"2024-04-25 02:05:47.385052","last_peered":"2024-04-25 02:05:47.385052","last_clean":"2024-04-25 02:05:47.385052","last_became_active":"2024-04-25 02:05:47.002460","last_became_peered":"2024-04-25 02:05:47.002460","last_unstale":"2024-04-25 02:05:47.385052","last_undegraded":"2024-04-25 02:05:47.385052","last_fullsized":"2024-04-25 02:05:47.385052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]}]}]}} 2024-04-25T02:05:58.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.327 7efe5b225700 1 Processor -- start 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.327 7efe5b225700 1 -- start start 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe5b225700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540f2090 0x7efe541a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe5b225700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541a8c80 0x7efe541ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe5b225700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540f9230 con 0x7efe540f5920 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe5b225700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe540f24e0 con 0x7efe541a8c80 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe5b225700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe541ac720 con 0x7efe540f2090 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe537fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540f2090 0x7efe541a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe53fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efe540f5920 0x7efe540f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46810/0 (socket says 172.21.15.57:46810) 2024-04-25T02:05:58.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe58821700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541a8c80 0x7efe541ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe53fff700 1 -- 172.21.15.57:0/375707333 learned_addr learned my addr 172.21.15.57:0/375707333 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe58821700 1 -- 172.21.15.57:0/375707333 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540f2090 msgr2=0x7efe541a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe58821700 1 --2- 172.21.15.57:0/375707333 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540f2090 0x7efe541a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe52ffd700 1 -- 172.21.15.57:0/375707333 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385884219 0 0) 0x7efe44001110 con 0x7efe540f5920 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe58821700 1 -- 172.21.15.57:0/375707333 >> v1:172.21.15.57:6789/0 conn(0x7efe540f5920 legacy=0x7efe540f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe58821700 1 -- 172.21.15.57:0/375707333 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe541ac8d0 con 0x7efe541a8c80 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe537fe700 1 --2- 172.21.15.57:0/375707333 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540f2090 0x7efe541a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.328 7efe58821700 1 --2- 172.21.15.57:0/375707333 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541a8c80 0x7efe541ab0e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7efe540f4640 tx=0x7efe4c009d70).ready entity=mon.1 client_cookie=37af8b8c6d27f888 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe52ffd700 1 -- 172.21.15.57:0/375707333 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efe541ac8d0 con 0x7efe541a8c80 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe52ffd700 1 -- 172.21.15.57:0/375707333 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c00b7c0 con 0x7efe541a8c80 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe52ffd700 1 -- 172.21.15.57:0/375707333 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efe4c00b9a0 con 0x7efe541a8c80 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe5b225700 1 -- 172.21.15.57:0/375707333 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541a8c80 msgr2=0x7efe541ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe5b225700 1 --2- 172.21.15.57:0/375707333 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541a8c80 0x7efe541ab0e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7efe540f4640 tx=0x7efe4c009d70).stop 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe5b225700 1 -- 172.21.15.57:0/375707333 shutdown_connections 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe5b225700 1 --2- 172.21.15.57:0/375707333 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541a8c80 0x7efe541ab0e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe5b225700 1 --2- 172.21.15.57:0/375707333 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540f2090 0x7efe541a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe5b225700 1 -- 172.21.15.57:0/375707333 >> 172.21.15.57:0/375707333 conn(0x7efe54113a70 msgr2=0x7efe540f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:58.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe5b225700 1 -- 172.21.15.57:0/375707333 shutdown_connections 2024-04-25T02:05:58.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.329 7efe5b225700 1 -- 172.21.15.57:0/375707333 wait complete. 2024-04-25T02:05:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.353 7efe5b225700 1 Processor -- start 2024-04-25T02:05:58.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.353 7efe5b225700 1 -- start start 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe5b225700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541b4e10 0x7efe541b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe5b225700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540c69a0 0x7efe540c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe5b225700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe540c7420 0x7efe541bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe5b225700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe540c6650 con 0x7efe540c7420 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe5b225700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe540bc940 con 0x7efe541b4e10 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe5b225700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe541b5890 con 0x7efe540c69a0 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe53fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541b4e10 0x7efe541b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe537fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540c69a0 0x7efe540c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe53fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541b4e10 0x7efe541b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47734/0 (socket says 172.21.15.57:47734) 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe53fff700 1 -- 172.21.15.57:0/3488533562 learned_addr learned my addr 172.21.15.57:0/3488533562 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe58821700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe540c7420 0x7efe541bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe537fe700 1 -- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541b4e10 msgr2=0x7efe541b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe537fe700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541b4e10 0x7efe541b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe537fe700 1 -- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe540c7420 msgr2=0x7efe541bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe537fe700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe540c7420 0x7efe541bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe537fe700 1 -- 172.21.15.57:0/3488533562 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540c7870 con 0x7efe540c69a0 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe58821700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe540c7420 0x7efe541bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe53fff700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541b4e10 0x7efe541b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe537fe700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540c69a0 0x7efe540c6df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7efe540bd520 tx=0x7efe4800ebd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe517fa700 1 -- 172.21.15.57:0/3488533562 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efe540c7870 con 0x7efe540c69a0 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe517fa700 1 -- 172.21.15.57:0/3488533562 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4800c7f0 con 0x7efe540c69a0 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.354 7efe5b225700 1 -- 172.21.15.57:0/3488533562 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe540bc390 con 0x7efe540c69a0 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.355 7efe517fa700 1 -- 172.21.15.57:0/3488533562 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efe4800f040 con 0x7efe540c69a0 2024-04-25T02:05:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.355 7efe5b225700 1 -- 172.21.15.57:0/3488533562 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe541bc550 con 0x7efe540c69a0 2024-04-25T02:05:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.355 7efe517fa700 1 -- 172.21.15.57:0/3488533562 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7efe48011070 con 0x7efe540c69a0 2024-04-25T02:05:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.355 7efe517fa700 1 -- 172.21.15.57:0/3488533562 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7efe48010040 con 0x7efe540c69a0 2024-04-25T02:05:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.356 7efe5b225700 1 -- 172.21.15.57:0/3488533562 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe540f08e0 con 0x7efe540c69a0 2024-04-25T02:05:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.359 7efe517fa700 1 -- 172.21.15.57:0/3488533562 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7efe4800c3f0 con 0x7efe540c69a0 2024-04-25T02:05:58.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.465 7efe5b225700 1 -- 172.21.15.57:0/3488533562 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7efe54087810 con 0x7efe340145b0 2024-04-25T02:05:58.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.473 7efe517fa700 1 -- 172.21.15.57:0/3488533562 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306092 (unknown 2965378022 0 2099062542) 0x7efe44001580 con 0x7efe340145b0 2024-04-25T02:05:58.482 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:58.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 -- 172.21.15.57:0/3488533562 >> v1:172.21.15.57:6816/43033 conn(0x7efe340145b0 legacy=0x7efe34016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 -- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540c69a0 msgr2=0x7efe540c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540c69a0 0x7efe540c6df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7efe540bd520 tx=0x7efe4800ebd0).stop 2024-04-25T02:05:58.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 -- 172.21.15.57:0/3488533562 shutdown_connections 2024-04-25T02:05:58.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe540c7420 0x7efe541bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe541b4e10 0x7efe541b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 --2- 172.21.15.57:0/3488533562 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe540c69a0 0x7efe540c6df0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 -- 172.21.15.57:0/3488533562 >> 172.21.15.57:0/3488533562 conn(0x7efe540bd880 msgr2=0x7efe540c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:58.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 -- 172.21.15.57:0/3488533562 shutdown_connections 2024-04-25T02:05:58.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.476 7efe5b225700 1 -- 172.21.15.57:0/3488533562 wait complete. 2024-04-25T02:05:58.485 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:05:58.492 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25 02:05:56.667485","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194944,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292416,"statfs":{"total":386547056640,"available":382251433984,"internally_reserved":4294967296,"allocated":622592,"data_stored":161692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001357"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372976","last_change":"2024-04-25 02:05:47.369320","last_active":"2024-04-25 02:05:47.372976","last_peered":"2024-04-25 02:05:47.372976","last_clean":"2024-04-25 02:05:47.372976","last_became_active":"2024-04-25 02:05:47.369008","last_became_peered":"2024-04-25 02:05:47.369008","last_unstale":"2024-04-25 02:05:47.372976","last_undegraded":"2024-04-25 02:05:47.372976","last_fullsized":"2024-04-25 02:05:47.372976","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358525","last_change":"2024-04-25 02:05:47.021686","last_active":"2024-04-25 02:05:47.358525","last_peered":"2024-04-25 02:05:47.358525","last_clean":"2024-04-25 02:05:47.358525","last_became_active":"2024-04-25 02:05:47.020938","last_became_peered":"2024-04-25 02:05:47.020938","last_unstale":"2024-04-25 02:05:47.358525","last_undegraded":"2024-04-25 02:05:47.358525","last_fullsized":"2024-04-25 02:05:47.358525","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388999","last_change":"2024-04-25 02:05:47.384312","last_active":"2024-04-25 02:05:47.388999","last_peered":"2024-04-25 02:05:47.388999","last_clean":"2024-04-25 02:05:47.388999","last_became_active":"2024-04-25 02:05:47.378585","last_became_peered":"2024-04-25 02:05:47.378585","last_unstale":"2024-04-25 02:05:47.388999","last_undegraded":"2024-04-25 02:05:47.388999","last_fullsized":"2024-04-25 02:05:47.388999","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363658","last_change":"2024-04-25 02:05:47.020533","last_active":"2024-04-25 02:05:47.363658","last_peered":"2024-04-25 02:05:47.363658","last_clean":"2024-04-25 02:05:47.363658","last_became_active":"2024-04-25 02:05:47.019990","last_became_peered":"2024-04-25 02:05:47.019990","last_unstale":"2024-04-25 02:05:47.363658","last_undegraded":"2024-04-25 02:05:47.363658","last_fullsized":"2024-04-25 02:05:47.363658","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388734","last_change":"2024-04-25 02:05:47.379801","last_active":"2024-04-25 02:05:47.388734","last_peered":"2024-04-25 02:05:47.388734","last_clean":"2024-04-25 02:05:47.388734","last_became_active":"2024-04-25 02:05:47.379321","last_became_peered":"2024-04-25 02:05:47.379321","last_unstale":"2024-04-25 02:05:47.388734","last_undegraded":"2024-04-25 02:05:47.388734","last_fullsized":"2024-04-25 02:05:47.388734","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357766","last_change":"2024-04-25 02:05:47.020828","last_active":"2024-04-25 02:05:47.357766","last_peered":"2024-04-25 02:05:47.357766","last_clean":"2024-04-25 02:05:47.357766","last_became_active":"2024-04-25 02:05:47.020320","last_became_peered":"2024-04-25 02:05:47.020320","last_unstale":"2024-04-25 02:05:47.357766","last_undegraded":"2024-04-25 02:05:47.357766","last_fullsized":"2024-04-25 02:05:47.357766","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373126","last_change":"2024-04-25 02:05:47.365068","last_active":"2024-04-25 02:05:47.373126","last_peered":"2024-04-25 02:05:47.373126","last_clean":"2024-04-25 02:05:47.373126","last_became_active":"2024-04-25 02:05:47.364768","last_became_peered":"2024-04-25 02:05:47.364768","last_unstale":"2024-04-25 02:05:47.373126","last_undegraded":"2024-04-25 02:05:47.373126","last_fullsized":"2024-04-25 02:05:47.373126","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.355780","last_change":"2024-04-25 02:05:47.028823","last_active":"2024-04-25 02:05:47.355780","last_peered":"2024-04-25 02:05:47.355780","last_clean":"2024-04-25 02:05:47.355780","last_became_active":"2024-04-25 02:05:47.027770","last_became_peered":"2024-04-25 02:05:47.027770","last_unstale":"2024-04-25 02:05:47.355780","last_undegraded":"2024-04-25 02:05:47.355780","last_fullsized":"2024-04-25 02:05:47.355780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382006","last_change":"2024-04-25 02:05:47.377307","last_active":"2024-04-25 02:05:47.382006","last_peered":"2024-04-25 02:05:47.382006","last_clean":"2024-04-25 02:05:47.382006","last_became_active":"2024-04-25 02:05:47.376546","last_became_peered":"2024-04-25 02:05:47.376546","last_unstale":"2024-04-25 02:05:47.382006","last_undegraded":"2024-04-25 02:05:47.382006","last_fullsized":"2024-04-25 02:05:47.382006","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353187","last_change":"2024-04-25 02:05:46.996093","last_active":"2024-04-25 02:05:47.353187","last_peered":"2024-04-25 02:05:47.353187","last_clean":"2024-04-25 02:05:47.353187","last_became_active":"2024-04-25 02:05:46.995769","last_became_peered":"2024-04-25 02:05:46.995769","last_unstale":"2024-04-25 02:05:47.353187","last_undegraded":"2024-04-25 02:05:47.353187","last_fullsized":"2024-04-25 02:05:47.353187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390769","last_change":"2024-04-25 02:05:47.385883","last_active":"2024-04-25 02:05:47.390769","last_peered":"2024-04-25 02:05:47.390769","last_clean":"2024-04-25 02:05:47.390769","last_became_active":"2024-04-25 02:05:47.385568","last_became_peered":"2024-04-25 02:05:47.385568","last_unstale":"2024-04-25 02:05:47.390769","last_undegraded":"2024-04-25 02:05:47.390769","last_fullsized":"2024-04-25 02:05:47.390769","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362579","last_change":"2024-04-25 02:05:47.006764","last_active":"2024-04-25 02:05:47.362579","last_peered":"2024-04-25 02:05:47.362579","last_clean":"2024-04-25 02:05:47.362579","last_became_active":"2024-04-25 02:05:47.006519","last_became_peered":"2024-04-25 02:05:47.006519","last_unstale":"2024-04-25 02:05:47.362579","last_undegraded":"2024-04-25 02:05:47.362579","last_fullsized":"2024-04-25 02:05:47.362579","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391008","last_change":"2024-04-25 02:05:47.385392","last_active":"2024-04-25 02:05:47.391008","last_peered":"2024-04-25 02:05:47.391008","last_clean":"2024-04-25 02:05:47.391008","last_became_active":"2024-04-25 02:05:47.385092","last_became_peered":"2024-04-25 02:05:47.385092","last_unstale":"2024-04-25 02:05:47.391008","last_undegraded":"2024-04-25 02:05:47.391008","last_fullsized":"2024-04-25 02:05:47.391008","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387246","last_change":"2024-04-25 02:05:47.003242","last_active":"2024-04-25 02:05:47.387246","last_peered":"2024-04-25 02:05:47.387246","last_clean":"2024-04-25 02:05:47.387246","last_became_active":"2024-04-25 02:05:47.002466","last_became_peered":"2024-04-25 02:05:47.002466","last_unstale":"2024-04-25 02:05:47.387246","last_undegraded":"2024-04-25 02:05:47.387246","last_fullsized":"2024-04-25 02:05:47.387246","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390926","last_change":"2024-04-25 02:05:47.387162","last_active":"2024-04-25 02:05:47.390926","last_peered":"2024-04-25 02:05:47.390926","last_clean":"2024-04-25 02:05:47.390926","last_became_active":"2024-04-25 02:05:47.386846","last_became_peered":"2024-04-25 02:05:47.386846","last_unstale":"2024-04-25 02:05:47.390926","last_undegraded":"2024-04-25 02:05:47.390926","last_fullsized":"2024-04-25 02:05:47.390926","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390398","last_change":"2024-04-25 02:05:47.012882","last_active":"2024-04-25 02:05:47.390398","last_peered":"2024-04-25 02:05:47.390398","last_clean":"2024-04-25 02:05:47.390398","last_became_active":"2024-04-25 02:05:47.012356","last_became_peered":"2024-04-25 02:05:47.012356","last_unstale":"2024-04-25 02:05:47.390398","last_undegraded":"2024-04-25 02:05:47.390398","last_fullsized":"2024-04-25 02:05:47.390398","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.381620","last_change":"2024-04-25 02:05:47.376840","last_active":"2024-04-25 02:05:47.381620","last_peered":"2024-04-25 02:05:47.381620","last_clean":"2024-04-25 02:05:47.381620","last_became_active":"2024-04-25 02:05:47.376550","last_became_peered":"2024-04-25 02:05:47.376550","last_unstale":"2024-04-25 02:05:47.381620","last_undegraded":"2024-04-25 02:05:47.381620","last_fullsized":"2024-04-25 02:05:47.381620","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390373","last_change":"2024-04-25 02:05:47.013902","last_active":"2024-04-25 02:05:47.390373","last_peered":"2024-04-25 02:05:47.390373","last_clean":"2024-04-25 02:05:47.390373","last_became_active":"2024-04-25 02:05:47.013571","last_became_peered":"2024-04-25 02:05:47.013571","last_unstale":"2024-04-25 02:05:47.390373","last_undegraded":"2024-04-25 02:05:47.390373","last_fullsized":"2024-04-25 02:05:47.390373","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391228","last_change":"2024-04-25 02:05:47.388939","last_active":"2024-04-25 02:05:47.391228","last_peered":"2024-04-25 02:05:47.391228","last_clean":"2024-04-25 02:05:47.391228","last_became_active":"2024-04-25 02:05:47.388673","last_became_peered":"2024-04-25 02:05:47.388673","last_unstale":"2024-04-25 02:05:47.391228","last_undegraded":"2024-04-25 02:05:47.391228","last_fullsized":"2024-04-25 02:05:47.391228","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363555","last_change":"2024-04-25 02:05:47.016797","last_active":"2024-04-25 02:05:47.363555","last_peered":"2024-04-25 02:05:47.363555","last_clean":"2024-04-25 02:05:47.363555","last_became_active":"2024-04-25 02:05:47.016484","last_became_peered":"2024-04-25 02:05:47.016484","last_unstale":"2024-04-25 02:05:47.363555","last_undegraded":"2024-04-25 02:05:47.363555","last_fullsized":"2024-04-25 02:05:47.363555","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373750","last_change":"2024-04-25 02:05:47.363022","last_active":"2024-04-25 02:05:47.373750","last_peered":"2024-04-25 02:05:47.373750","last_clean":"2024-04-25 02:05:47.373750","last_became_active":"2024-04-25 02:05:47.362681","last_became_peered":"2024-04-25 02:05:47.362681","last_unstale":"2024-04-25 02:05:47.373750","last_undegraded":"2024-04-25 02:05:47.373750","last_fullsized":"2024-04-25 02:05:47.373750","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360184","last_change":"2024-04-25 02:05:47.012986","last_active":"2024-04-25 02:05:47.360184","last_peered":"2024-04-25 02:05:47.360184","last_clean":"2024-04-25 02:05:47.360184","last_became_active":"2024-04-25 02:05:47.012673","last_became_peered":"2024-04-25 02:05:47.012673","last_unstale":"2024-04-25 02:05:47.360184","last_undegraded":"2024-04-25 02:05:47.360184","last_fullsized":"2024-04-25 02:05:47.360184","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388639","last_change":"2024-04-25 02:05:47.378766","last_active":"2024-04-25 02:05:47.388639","last_peered":"2024-04-25 02:05:47.388639","last_clean":"2024-04-25 02:05:47.388639","last_became_active":"2024-04-25 02:05:47.376368","last_became_peered":"2024-04-25 02:05:47.376368","last_unstale":"2024-04-25 02:05:47.388639","last_undegraded":"2024-04-25 02:05:47.388639","last_fullsized":"2024-04-25 02:05:47.388639","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386504","last_change":"2024-04-25 02:05:47.003903","last_active":"2024-04-25 02:05:47.386504","last_peered":"2024-04-25 02:05:47.386504","last_clean":"2024-04-25 02:05:47.386504","last_became_active":"2024-04-25 02:05:47.003584","last_became_peered":"2024-04-25 02:05:47.003584","last_unstale":"2024-04-25 02:05:47.386504","last_undegraded":"2024-04-25 02:05:47.386504","last_fullsized":"2024-04-25 02:05:47.386504","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391545","last_change":"2024-04-25 02:05:47.382468","last_active":"2024-04-25 02:05:47.391545","last_peered":"2024-04-25 02:05:47.391545","last_clean":"2024-04-25 02:05:47.391545","last_became_active":"2024-04-25 02:05:47.382161","last_became_peered":"2024-04-25 02:05:47.382161","last_unstale":"2024-04-25 02:05:47.391545","last_undegraded":"2024-04-25 02:05:47.391545","last_fullsized":"2024-04-25 02:05:47.391545","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380007","last_change":"2024-04-25 02:05:47.014185","last_active":"2024-04-25 02:05:47.380007","last_peered":"2024-04-25 02:05:47.380007","last_clean":"2024-04-25 02:05:47.380007","last_became_active":"2024-04-25 02:05:47.013874","last_became_peered":"2024-04-25 02:05:47.013874","last_unstale":"2024-04-25 02:05:47.380007","last_undegraded":"2024-04-25 02:05:47.380007","last_fullsized":"2024-04-25 02:05:47.380007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383613","last_change":"2024-04-25 02:05:47.375244","last_active":"2024-04-25 02:05:47.383613","last_peered":"2024-04-25 02:05:47.383613","last_clean":"2024-04-25 02:05:47.383613","last_became_active":"2024-04-25 02:05:47.374904","last_became_peered":"2024-04-25 02:05:47.374904","last_unstale":"2024-04-25 02:05:47.383613","last_undegraded":"2024-04-25 02:05:47.383613","last_fullsized":"2024-04-25 02:05:47.383613","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391628","last_change":"2024-04-25 02:05:47.013961","last_active":"2024-04-25 02:05:47.391628","last_peered":"2024-04-25 02:05:47.391628","last_clean":"2024-04-25 02:05:47.391628","last_became_active":"2024-04-25 02:05:47.013634","last_became_peered":"2024-04-25 02:05:47.013634","last_unstale":"2024-04-25 02:05:47.391628","last_undegraded":"2024-04-25 02:05:47.391628","last_fullsized":"2024-04-25 02:05:47.391628","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387497","last_change":"2024-04-25 02:05:47.380961","last_active":"2024-04-25 02:05:47.387497","last_peered":"2024-04-25 02:05:47.387497","last_clean":"2024-04-25 02:05:47.387497","last_became_active":"2024-04-25 02:05:47.380213","last_became_peered":"2024-04-25 02:05:47.380213","last_unstale":"2024-04-25 02:05:47.387497","last_undegraded":"2024-04-25 02:05:47.387497","last_fullsized":"2024-04-25 02:05:47.387497","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353098","last_change":"2024-04-25 02:05:47.002799","last_active":"2024-04-25 02:05:47.353098","last_peered":"2024-04-25 02:05:47.353098","last_clean":"2024-04-25 02:05:47.353098","last_became_active":"2024-04-25 02:05:47.002131","last_became_peered":"2024-04-25 02:05:47.002131","last_unstale":"2024-04-25 02:05:47.353098","last_undegraded":"2024-04-25 02:05:47.353098","last_fullsized":"2024-04-25 02:05:47.353098","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386374","last_change":"2024-04-25 02:05:47.372655","last_active":"2024-04-25 02:05:47.386374","last_peered":"2024-04-25 02:05:47.386374","last_clean":"2024-04-25 02:05:47.386374","last_became_active":"2024-04-25 02:05:47.372344","last_became_peered":"2024-04-25 02:05:47.372344","last_unstale":"2024-04-25 02:05:47.386374","last_undegraded":"2024-04-25 02:05:47.386374","last_fullsized":"2024-04-25 02:05:47.386374","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352064","last_change":"2024-04-25 02:05:46.999849","last_active":"2024-04-25 02:05:47.352064","last_peered":"2024-04-25 02:05:47.352064","last_clean":"2024-04-25 02:05:47.352064","last_became_active":"2024-04-25 02:05:46.999494","last_became_peered":"2024-04-25 02:05:46.999494","last_unstale":"2024-04-25 02:05:47.352064","last_undegraded":"2024-04-25 02:05:47.352064","last_fullsized":"2024-04-25 02:05:47.352064","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388549","last_change":"2024-04-25 02:05:47.377522","last_active":"2024-04-25 02:05:47.388549","last_peered":"2024-04-25 02:05:47.388549","last_clean":"2024-04-25 02:05:47.388549","last_became_active":"2024-04-25 02:05:47.374641","last_became_peered":"2024-04-25 02:05:47.374641","last_unstale":"2024-04-25 02:05:47.388549","last_undegraded":"2024-04-25 02:05:47.388549","last_fullsized":"2024-04-25 02:05:47.388549","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389608","last_change":"2024-04-25 02:05:47.017557","last_active":"2024-04-25 02:05:47.389608","last_peered":"2024-04-25 02:05:47.389608","last_clean":"2024-04-25 02:05:47.389608","last_became_active":"2024-04-25 02:05:47.017189","last_became_peered":"2024-04-25 02:05:47.017189","last_unstale":"2024-04-25 02:05:47.389608","last_undegraded":"2024-04-25 02:05:47.389608","last_fullsized":"2024-04-25 02:05:47.389608","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389984","last_change":"2024-04-25 02:05:47.386122","last_active":"2024-04-25 02:05:47.389984","last_peered":"2024-04-25 02:05:47.389984","last_clean":"2024-04-25 02:05:47.389984","last_became_active":"2024-04-25 02:05:47.385756","last_became_peered":"2024-04-25 02:05:47.385756","last_unstale":"2024-04-25 02:05:47.389984","last_undegraded":"2024-04-25 02:05:47.389984","last_fullsized":"2024-04-25 02:05:47.389984","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352989","last_change":"2024-04-25 02:05:47.019790","last_active":"2024-04-25 02:05:47.352989","last_peered":"2024-04-25 02:05:47.352989","last_clean":"2024-04-25 02:05:47.352989","last_became_active":"2024-04-25 02:05:47.019471","last_became_peered":"2024-04-25 02:05:47.019471","last_unstale":"2024-04-25 02:05:47.352989","last_undegraded":"2024-04-25 02:05:47.352989","last_fullsized":"2024-04-25 02:05:47.352989","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389192","last_change":"2024-04-25 02:05:47.380774","last_active":"2024-04-25 02:05:47.389192","last_peered":"2024-04-25 02:05:47.389192","last_clean":"2024-04-25 02:05:47.389192","last_became_active":"2024-04-25 02:05:47.380517","last_became_peered":"2024-04-25 02:05:47.380517","last_unstale":"2024-04-25 02:05:47.389192","last_undegraded":"2024-04-25 02:05:47.389192","last_fullsized":"2024-04-25 02:05:47.389192","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352014","last_change":"2024-04-25 02:05:47.005189","last_active":"2024-04-25 02:05:47.352014","last_peered":"2024-04-25 02:05:47.352014","last_clean":"2024-04-25 02:05:47.352014","last_became_active":"2024-04-25 02:05:47.004657","last_became_peered":"2024-04-25 02:05:47.004657","last_unstale":"2024-04-25 02:05:47.352014","last_undegraded":"2024-04-25 02:05:47.352014","last_fullsized":"2024-04-25 02:05:47.352014","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388617","last_change":"2024-04-25 02:05:47.377256","last_active":"2024-04-25 02:05:47.388617","last_peered":"2024-04-25 02:05:47.388617","last_clean":"2024-04-25 02:05:47.388617","last_became_active":"2024-04-25 02:05:47.376589","last_became_peered":"2024-04-25 02:05:47.376589","last_unstale":"2024-04-25 02:05:47.388617","last_undegraded":"2024-04-25 02:05:47.388617","last_fullsized":"2024-04-25 02:05:47.388617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359016","last_change":"2024-04-25 02:05:46.994018","last_active":"2024-04-25 02:05:47.359016","last_peered":"2024-04-25 02:05:47.359016","last_clean":"2024-04-25 02:05:47.359016","last_became_active":"2024-04-25 02:05:46.993698","last_became_peered":"2024-04-25 02:05:46.993698","last_unstale":"2024-04-25 02:05:47.359016","last_undegraded":"2024-04-25 02:05:47.359016","last_fullsized":"2024-04-25 02:05:47.359016","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389233","last_change":"2024-04-25 02:05:47.382653","last_active":"2024-04-25 02:05:47.389233","last_peered":"2024-04-25 02:05:47.389233","last_clean":"2024-04-25 02:05:47.389233","last_became_active":"2024-04-25 02:05:47.382376","last_became_peered":"2024-04-25 02:05:47.382376","last_unstale":"2024-04-25 02:05:47.389233","last_undegraded":"2024-04-25 02:05:47.389233","last_fullsized":"2024-04-25 02:05:47.389233","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352520","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:05:47.352520","last_peered":"2024-04-25 02:05:47.352520","last_clean":"2024-04-25 02:05:47.352520","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:05:47.352520","last_undegraded":"2024-04-25 02:05:47.352520","last_fullsized":"2024-04-25 02:05:47.352520","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353532","last_change":"2024-04-25 02:05:47.001851","last_active":"2024-04-25 02:05:47.353532","last_peered":"2024-04-25 02:05:47.353532","last_clean":"2024-04-25 02:05:47.353532","last_became_active":"2024-04-25 02:05:47.001503","last_became_peered":"2024-04-25 02:05:47.001503","last_unstale":"2024-04-25 02:05:47.353532","last_undegraded":"2024-04-25 02:05:47.353532","last_fullsized":"2024-04-25 02:05:47.353532","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384277","last_change":"2024-04-25 02:05:47.378248","last_active":"2024-04-25 02:05:47.384277","last_peered":"2024-04-25 02:05:47.384277","last_clean":"2024-04-25 02:05:47.384277","last_became_active":"2024-04-25 02:05:47.377943","last_became_peered":"2024-04-25 02:05:47.377943","last_unstale":"2024-04-25 02:05:47.384277","last_undegraded":"2024-04-25 02:05:47.384277","last_fullsized":"2024-04-25 02:05:47.384277","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360052","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:05:47.360052","last_peered":"2024-04-25 02:05:47.360052","last_clean":"2024-04-25 02:05:47.360052","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:05:47.360052","last_undegraded":"2024-04-25 02:05:47.360052","last_fullsized":"2024-04-25 02:05:47.360052","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388406","last_change":"2024-04-25 02:05:47.021725","last_active":"2024-04-25 02:05:47.388406","last_peered":"2024-04-25 02:05:47.388406","last_clean":"2024-04-25 02:05:47.388406","last_became_active":"2024-04-25 02:05:47.021378","last_became_peered":"2024-04-25 02:05:47.021378","last_unstale":"2024-04-25 02:05:47.388406","last_undegraded":"2024-04-25 02:05:47.388406","last_fullsized":"2024-04-25 02:05:47.388406","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352584","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:05:47.352584","last_peered":"2024-04-25 02:05:47.352584","last_clean":"2024-04-25 02:05:47.352584","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:05:47.352584","last_undegraded":"2024-04-25 02:05:47.352584","last_fullsized":"2024-04-25 02:05:47.352584","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356151","last_change":"2024-04-25 02:05:47.028109","last_active":"2024-04-25 02:05:47.356151","last_peered":"2024-04-25 02:05:47.356151","last_clean":"2024-04-25 02:05:47.356151","last_became_active":"2024-04-25 02:05:47.026998","last_became_peered":"2024-04-25 02:05:47.026998","last_unstale":"2024-04-25 02:05:47.356151","last_undegraded":"2024-04-25 02:05:47.356151","last_fullsized":"2024-04-25 02:05:47.356151","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388917","last_change":"2024-04-25 02:05:47.384104","last_active":"2024-04-25 02:05:47.388917","last_peered":"2024-04-25 02:05:47.388917","last_clean":"2024-04-25 02:05:47.388917","last_became_active":"2024-04-25 02:05:47.383783","last_became_peered":"2024-04-25 02:05:47.383783","last_unstale":"2024-04-25 02:05:47.388917","last_undegraded":"2024-04-25 02:05:47.388917","last_fullsized":"2024-04-25 02:05:47.388917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360990","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:05:47.360990","last_peered":"2024-04-25 02:05:47.360990","last_clean":"2024-04-25 02:05:47.360990","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:05:47.360990","last_undegraded":"2024-04-25 02:05:47.360990","last_fullsized":"2024-04-25 02:05:47.360990","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351208","last_change":"2024-04-25 02:05:47.013050","last_active":"2024-04-25 02:05:47.351208","last_peered":"2024-04-25 02:05:47.351208","last_clean":"2024-04-25 02:05:47.351208","last_became_active":"2024-04-25 02:05:47.012558","last_became_peered":"2024-04-25 02:05:47.012558","last_unstale":"2024-04-25 02:05:47.351208","last_undegraded":"2024-04-25 02:05:47.351208","last_fullsized":"2024-04-25 02:05:47.351208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373782","last_change":"2024-04-25 02:05:47.363093","last_active":"2024-04-25 02:05:47.373782","last_peered":"2024-04-25 02:05:47.373782","last_clean":"2024-04-25 02:05:47.373782","last_became_active":"2024-04-25 02:05:47.362753","last_became_peered":"2024-04-25 02:05:47.362753","last_unstale":"2024-04-25 02:05:47.373782","last_undegraded":"2024-04-25 02:05:47.373782","last_fullsized":"2024-04-25 02:05:47.373782","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352385","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:05:47.352385","last_peered":"2024-04-25 02:05:47.352385","last_clean":"2024-04-25 02:05:47.352385","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:05:47.352385","last_undegraded":"2024-04-25 02:05:47.352385","last_fullsized":"2024-04-25 02:05:47.352385","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356625","last_change":"2024-04-25 02:05:47.018087","last_active":"2024-04-25 02:05:47.356625","last_peered":"2024-04-25 02:05:47.356625","last_clean":"2024-04-25 02:05:47.356625","last_became_active":"2024-04-25 02:05:47.017799","last_became_peered":"2024-04-25 02:05:47.017799","last_unstale":"2024-04-25 02:05:47.356625","last_undegraded":"2024-04-25 02:05:47.356625","last_fullsized":"2024-04-25 02:05:47.356625","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387244","last_change":"2024-04-25 02:05:47.375657","last_active":"2024-04-25 02:05:47.387244","last_peered":"2024-04-25 02:05:47.387244","last_clean":"2024-04-25 02:05:47.387244","last_became_active":"2024-04-25 02:05:47.375334","last_became_peered":"2024-04-25 02:05:47.375334","last_unstale":"2024-04-25 02:05:47.387244","last_undegraded":"2024-04-25 02:05:47.387244","last_fullsized":"2024-04-25 02:05:47.387244","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.357499","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:05:47.357499","last_peered":"2024-04-25 02:05:47.357499","last_clean":"2024-04-25 02:05:47.357499","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:05:47.357499","last_undegraded":"2024-04-25 02:05:47.357499","last_fullsized":"2024-04-25 02:05:47.357499","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358000","last_change":"2024-04-25 02:05:47.029097","last_active":"2024-04-25 02:05:47.358000","last_peered":"2024-04-25 02:05:47.358000","last_clean":"2024-04-25 02:05:47.358000","last_became_active":"2024-04-25 02:05:47.025880","last_became_peered":"2024-04-25 02:05:47.025880","last_unstale":"2024-04-25 02:05:47.358000","last_undegraded":"2024-04-25 02:05:47.358000","last_fullsized":"2024-04-25 02:05:47.358000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390611","last_change":"2024-04-25 02:05:47.384976","last_active":"2024-04-25 02:05:47.390611","last_peered":"2024-04-25 02:05:47.390611","last_clean":"2024-04-25 02:05:47.390611","last_became_active":"2024-04-25 02:05:47.384672","last_became_peered":"2024-04-25 02:05:47.384672","last_unstale":"2024-04-25 02:05:47.390611","last_undegraded":"2024-04-25 02:05:47.390611","last_fullsized":"2024-04-25 02:05:47.390611","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360865","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:05:47.360865","last_peered":"2024-04-25 02:05:47.360865","last_clean":"2024-04-25 02:05:47.360865","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:05:47.360865","last_undegraded":"2024-04-25 02:05:47.360865","last_fullsized":"2024-04-25 02:05:47.360865","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359901","last_change":"2024-04-25 02:05:47.026109","last_active":"2024-04-25 02:05:47.359901","last_peered":"2024-04-25 02:05:47.359901","last_clean":"2024-04-25 02:05:47.359901","last_became_active":"2024-04-25 02:05:47.025764","last_became_peered":"2024-04-25 02:05:47.025764","last_unstale":"2024-04-25 02:05:47.359901","last_undegraded":"2024-04-25 02:05:47.359901","last_fullsized":"2024-04-25 02:05:47.359901","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382178","last_change":"2024-04-25 02:05:47.377843","last_active":"2024-04-25 02:05:47.382178","last_peered":"2024-04-25 02:05:47.382178","last_clean":"2024-04-25 02:05:47.382178","last_became_active":"2024-04-25 02:05:47.377538","last_became_peered":"2024-04-25 02:05:47.377538","last_unstale":"2024-04-25 02:05:47.382178","last_undegraded":"2024-04-25 02:05:47.382178","last_fullsized":"2024-04-25 02:05:47.382178","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352612","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:05:47.352612","last_peered":"2024-04-25 02:05:47.352612","last_clean":"2024-04-25 02:05:47.352612","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:05:47.352612","last_undegraded":"2024-04-25 02:05:47.352612","last_fullsized":"2024-04-25 02:05:47.352612","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354313","last_change":"2024-04-25 02:05:47.004781","last_active":"2024-04-25 02:05:47.354313","last_peered":"2024-04-25 02:05:47.354313","last_clean":"2024-04-25 02:05:47.354313","last_became_active":"2024-04-25 02:05:47.004453","last_became_peered":"2024-04-25 02:05:47.004453","last_unstale":"2024-04-25 02:05:47.354313","last_undegraded":"2024-04-25 02:05:47.354313","last_fullsized":"2024-04-25 02:05:47.354313","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380248","last_change":"2024-04-25 02:05:47.376611","last_active":"2024-04-25 02:05:47.380248","last_peered":"2024-04-25 02:05:47.380248","last_clean":"2024-04-25 02:05:47.380248","last_became_active":"2024-04-25 02:05:47.376284","last_became_peered":"2024-04-25 02:05:47.376284","last_unstale":"2024-04-25 02:05:47.380248","last_undegraded":"2024-04-25 02:05:47.380248","last_fullsized":"2024-04-25 02:05:47.380248","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389945","last_change":"2024-04-25 02:05:47.387545","last_active":"2024-04-25 02:05:47.389945","last_peered":"2024-04-25 02:05:47.389945","last_clean":"2024-04-25 02:05:47.389945","last_became_active":"2024-04-25 02:05:47.387246","last_became_peered":"2024-04-25 02:05:47.387246","last_unstale":"2024-04-25 02:05:47.389945","last_undegraded":"2024-04-25 02:05:47.389945","last_fullsized":"2024-04-25 02:05:47.389945","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361706","last_change":"2024-04-25 02:05:47.006606","last_active":"2024-04-25 02:05:47.361706","last_peered":"2024-04-25 02:05:47.361706","last_clean":"2024-04-25 02:05:47.361706","last_became_active":"2024-04-25 02:05:47.006296","last_became_peered":"2024-04-25 02:05:47.006296","last_unstale":"2024-04-25 02:05:47.361706","last_undegraded":"2024-04-25 02:05:47.361706","last_fullsized":"2024-04-25 02:05:47.361706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387972","last_change":"2024-04-25 02:05:47.381933","last_active":"2024-04-25 02:05:47.387972","last_peered":"2024-04-25 02:05:47.387972","last_clean":"2024-04-25 02:05:47.387972","last_became_active":"2024-04-25 02:05:47.379588","last_became_peered":"2024-04-25 02:05:47.379588","last_unstale":"2024-04-25 02:05:47.387972","last_undegraded":"2024-04-25 02:05:47.387972","last_fullsized":"2024-04-25 02:05:47.387972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378078","last_change":"2024-04-25 02:05:47.008840","last_active":"2024-04-25 02:05:47.378078","last_peered":"2024-04-25 02:05:47.378078","last_clean":"2024-04-25 02:05:47.378078","last_became_active":"2024-04-25 02:05:47.008521","last_became_peered":"2024-04-25 02:05:47.008521","last_unstale":"2024-04-25 02:05:47.378078","last_undegraded":"2024-04-25 02:05:47.378078","last_fullsized":"2024-04-25 02:05:47.378078","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385090","last_change":"2024-04-25 02:05:47.378449","last_active":"2024-04-25 02:05:47.385090","last_peered":"2024-04-25 02:05:47.385090","last_clean":"2024-04-25 02:05:47.385090","last_became_active":"2024-04-25 02:05:47.371394","last_became_peered":"2024-04-25 02:05:47.371394","last_unstale":"2024-04-25 02:05:47.385090","last_undegraded":"2024-04-25 02:05:47.385090","last_fullsized":"2024-04-25 02:05:47.385090","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389698","last_change":"2024-04-25 02:05:47.021735","last_active":"2024-04-25 02:05:47.389698","last_peered":"2024-04-25 02:05:47.389698","last_clean":"2024-04-25 02:05:47.389698","last_became_active":"2024-04-25 02:05:47.021400","last_became_peered":"2024-04-25 02:05:47.021400","last_unstale":"2024-04-25 02:05:47.389698","last_undegraded":"2024-04-25 02:05:47.389698","last_fullsized":"2024-04-25 02:05:47.389698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389987","last_change":"2024-04-25 02:05:47.383033","last_active":"2024-04-25 02:05:47.389987","last_peered":"2024-04-25 02:05:47.389987","last_clean":"2024-04-25 02:05:47.389987","last_became_active":"2024-04-25 02:05:47.382717","last_became_peered":"2024-04-25 02:05:47.382717","last_unstale":"2024-04-25 02:05:47.389987","last_undegraded":"2024-04-25 02:05:47.389987","last_fullsized":"2024-04-25 02:05:47.389987","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389376","last_change":"2024-04-25 02:05:47.014112","last_active":"2024-04-25 02:05:47.389376","last_peered":"2024-04-25 02:05:47.389376","last_clean":"2024-04-25 02:05:47.389376","last_became_active":"2024-04-25 02:05:47.013624","last_became_peered":"2024-04-25 02:05:47.013624","last_unstale":"2024-04-25 02:05:47.389376","last_undegraded":"2024-04-25 02:05:47.389376","last_fullsized":"2024-04-25 02:05:47.389376","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.380606","last_change":"2024-04-25 02:05:47.373843","last_active":"2024-04-25 02:05:47.380606","last_peered":"2024-04-25 02:05:47.380606","last_clean":"2024-04-25 02:05:47.380606","last_became_active":"2024-04-25 02:05:47.369284","last_became_peered":"2024-04-25 02:05:47.369284","last_unstale":"2024-04-25 02:05:47.380606","last_undegraded":"2024-04-25 02:05:47.380606","last_fullsized":"2024-04-25 02:05:47.380606","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.356604","last_change":"2024-04-25 02:05:47.028330","last_active":"2024-04-25 02:05:47.356604","last_peered":"2024-04-25 02:05:47.356604","last_clean":"2024-04-25 02:05:47.356604","last_became_active":"2024-04-25 02:05:47.027257","last_became_peered":"2024-04-25 02:05:47.027257","last_unstale":"2024-04-25 02:05:47.356604","last_undegraded":"2024-04-25 02:05:47.356604","last_fullsized":"2024-04-25 02:05:47.356604","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.375879","last_change":"2024-04-25 02:05:47.366400","last_active":"2024-04-25 02:05:47.375879","last_peered":"2024-04-25 02:05:47.375879","last_clean":"2024-04-25 02:05:47.375879","last_became_active":"2024-04-25 02:05:47.366000","last_became_peered":"2024-04-25 02:05:47.366000","last_unstale":"2024-04-25 02:05:47.375879","last_undegraded":"2024-04-25 02:05:47.375879","last_fullsized":"2024-04-25 02:05:47.375879","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351200","last_change":"2024-04-25 02:05:46.999953","last_active":"2024-04-25 02:05:47.351200","last_peered":"2024-04-25 02:05:47.351200","last_clean":"2024-04-25 02:05:47.351200","last_became_active":"2024-04-25 02:05:46.999606","last_became_peered":"2024-04-25 02:05:46.999606","last_unstale":"2024-04-25 02:05:47.351200","last_undegraded":"2024-04-25 02:05:47.351200","last_fullsized":"2024-04-25 02:05:47.351200","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387617","last_change":"2024-04-25 02:05:47.381525","last_active":"2024-04-25 02:05:47.387617","last_peered":"2024-04-25 02:05:47.387617","last_clean":"2024-04-25 02:05:47.387617","last_became_active":"2024-04-25 02:05:47.378390","last_became_peered":"2024-04-25 02:05:47.378390","last_unstale":"2024-04-25 02:05:47.387617","last_undegraded":"2024-04-25 02:05:47.387617","last_fullsized":"2024-04-25 02:05:47.387617","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.363760","last_change":"2024-04-25 02:05:47.026754","last_active":"2024-04-25 02:05:47.363760","last_peered":"2024-04-25 02:05:47.363760","last_clean":"2024-04-25 02:05:47.363760","last_became_active":"2024-04-25 02:05:47.026391","last_became_peered":"2024-04-25 02:05:47.026391","last_unstale":"2024-04-25 02:05:47.363760","last_undegraded":"2024-04-25 02:05:47.363760","last_fullsized":"2024-04-25 02:05:47.363760","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388695","last_change":"2024-04-25 02:05:47.379347","last_active":"2024-04-25 02:05:47.388695","last_peered":"2024-04-25 02:05:47.388695","last_clean":"2024-04-25 02:05:47.388695","last_became_active":"2024-04-25 02:05:47.379040","last_became_peered":"2024-04-25 02:05:47.379040","last_unstale":"2024-04-25 02:05:47.388695","last_undegraded":"2024-04-25 02:05:47.388695","last_fullsized":"2024-04-25 02:05:47.388695","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.358961","last_change":"2024-04-25 02:05:47.027710","last_active":"2024-04-25 02:05:47.358961","last_peered":"2024-04-25 02:05:47.358961","last_clean":"2024-04-25 02:05:47.358961","last_became_active":"2024-04-25 02:05:47.027316","last_became_peered":"2024-04-25 02:05:47.027316","last_unstale":"2024-04-25 02:05:47.358961","last_undegraded":"2024-04-25 02:05:47.358961","last_fullsized":"2024-04-25 02:05:47.358961","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374780","last_change":"2024-04-25 02:05:47.372923","last_active":"2024-04-25 02:05:47.374780","last_peered":"2024-04-25 02:05:47.374780","last_clean":"2024-04-25 02:05:47.374780","last_became_active":"2024-04-25 02:05:47.372581","last_became_peered":"2024-04-25 02:05:47.372581","last_unstale":"2024-04-25 02:05:47.374780","last_undegraded":"2024-04-25 02:05:47.374780","last_fullsized":"2024-04-25 02:05:47.374780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.354411","last_change":"2024-04-25 02:05:47.004609","last_active":"2024-04-25 02:05:47.354411","last_peered":"2024-04-25 02:05:47.354411","last_clean":"2024-04-25 02:05:47.354411","last_became_active":"2024-04-25 02:05:47.001832","last_became_peered":"2024-04-25 02:05:47.001832","last_unstale":"2024-04-25 02:05:47.354411","last_undegraded":"2024-04-25 02:05:47.354411","last_fullsized":"2024-04-25 02:05:47.354411","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390986","last_change":"2024-04-25 02:05:47.380256","last_active":"2024-04-25 02:05:47.390986","last_peered":"2024-04-25 02:05:47.390986","last_clean":"2024-04-25 02:05:47.390986","last_became_active":"2024-04-25 02:05:47.379963","last_became_peered":"2024-04-25 02:05:47.379963","last_unstale":"2024-04-25 02:05:47.390986","last_undegraded":"2024-04-25 02:05:47.390986","last_fullsized":"2024-04-25 02:05:47.390986","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352630","last_change":"2024-04-25 02:05:46.996348","last_active":"2024-04-25 02:05:47.352630","last_peered":"2024-04-25 02:05:47.352630","last_clean":"2024-04-25 02:05:47.352630","last_became_active":"2024-04-25 02:05:46.996069","last_became_peered":"2024-04-25 02:05:46.996069","last_unstale":"2024-04-25 02:05:47.352630","last_undegraded":"2024-04-25 02:05:47.352630","last_fullsized":"2024-04-25 02:05:47.352630","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389206","last_change":"2024-04-25 02:05:47.382589","last_active":"2024-04-25 02:05:47.389206","last_peered":"2024-04-25 02:05:47.389206","last_clean":"2024-04-25 02:05:47.389206","last_became_active":"2024-04-25 02:05:47.382307","last_became_peered":"2024-04-25 02:05:47.382307","last_unstale":"2024-04-25 02:05:47.389206","last_undegraded":"2024-04-25 02:05:47.389206","last_fullsized":"2024-04-25 02:05:47.389206","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2024-04-25 02:05:48.371682","last_change":"2024-04-25 02:05:46.999274","last_active":"2024-04-25 02:05:48.371682","last_peered":"2024-04-25 02:05:48.371682","last_clean":"2024-04-25 02:05:48.371682","last_became_active":"2024-04-25 02:05:46.998876","last_became_peered":"2024-04-25 02:05:46.998876","last_unstale":"2024-04-25 02:05:48.371682","last_undegraded":"2024-04-25 02:05:48.371682","last_fullsized":"2024-04-25 02:05:48.371682","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382025","last_change":"2024-04-25 02:05:47.377487","last_active":"2024-04-25 02:05:47.382025","last_peered":"2024-04-25 02:05:47.382025","last_clean":"2024-04-25 02:05:47.382025","last_became_active":"2024-04-25 02:05:47.376770","last_became_peered":"2024-04-25 02:05:47.376770","last_unstale":"2024-04-25 02:05:47.382025","last_undegraded":"2024-04-25 02:05:47.382025","last_fullsized":"2024-04-25 02:05:47.382025","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361361","last_change":"2024-04-25 02:05:47.026964","last_active":"2024-04-25 02:05:47.361361","last_peered":"2024-04-25 02:05:47.361361","last_clean":"2024-04-25 02:05:47.361361","last_became_active":"2024-04-25 02:05:47.026604","last_became_peered":"2024-04-25 02:05:47.026604","last_unstale":"2024-04-25 02:05:47.361361","last_undegraded":"2024-04-25 02:05:47.361361","last_fullsized":"2024-04-25 02:05:47.361361","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386703","last_change":"2024-04-25 02:05:47.375591","last_active":"2024-04-25 02:05:47.386703","last_peered":"2024-04-25 02:05:47.386703","last_clean":"2024-04-25 02:05:47.386703","last_became_active":"2024-04-25 02:05:47.375271","last_became_peered":"2024-04-25 02:05:47.375271","last_unstale":"2024-04-25 02:05:47.386703","last_undegraded":"2024-04-25 02:05:47.386703","last_fullsized":"2024-04-25 02:05:47.386703","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362340","last_change":"2024-04-25 02:05:47.028567","last_active":"2024-04-25 02:05:47.362340","last_peered":"2024-04-25 02:05:47.362340","last_clean":"2024-04-25 02:05:47.362340","last_became_active":"2024-04-25 02:05:47.027520","last_became_peered":"2024-04-25 02:05:47.027520","last_unstale":"2024-04-25 02:05:47.362340","last_undegraded":"2024-04-25 02:05:47.362340","last_fullsized":"2024-04-25 02:05:47.362340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387289","last_change":"2024-04-25 02:05:47.376362","last_active":"2024-04-25 02:05:47.387289","last_peered":"2024-04-25 02:05:47.387289","last_clean":"2024-04-25 02:05:47.387289","last_became_active":"2024-04-25 02:05:47.376045","last_became_peered":"2024-04-25 02:05:47.376045","last_unstale":"2024-04-25 02:05:47.387289","last_undegraded":"2024-04-25 02:05:47.387289","last_fullsized":"2024-04-25 02:05:47.387289","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351558","last_change":"2024-04-25 02:05:47.018376","last_active":"2024-04-25 02:05:47.351558","last_peered":"2024-04-25 02:05:47.351558","last_clean":"2024-04-25 02:05:47.351558","last_became_active":"2024-04-25 02:05:47.018044","last_became_peered":"2024-04-25 02:05:47.018044","last_unstale":"2024-04-25 02:05:47.351558","last_undegraded":"2024-04-25 02:05:47.351558","last_fullsized":"2024-04-25 02:05:47.351558","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389103","last_change":"2024-04-25 02:05:47.384783","last_active":"2024-04-25 02:05:47.389103","last_peered":"2024-04-25 02:05:47.389103","last_clean":"2024-04-25 02:05:47.389103","last_became_active":"2024-04-25 02:05:47.384440","last_became_peered":"2024-04-25 02:05:47.384440","last_unstale":"2024-04-25 02:05:47.389103","last_undegraded":"2024-04-25 02:05:47.389103","last_fullsized":"2024-04-25 02:05:47.389103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.352883","last_change":"2024-04-25 02:05:47.000733","last_active":"2024-04-25 02:05:47.352883","last_peered":"2024-04-25 02:05:47.352883","last_clean":"2024-04-25 02:05:47.352883","last_became_active":"2024-04-25 02:05:47.000381","last_became_peered":"2024-04-25 02:05:47.000381","last_unstale":"2024-04-25 02:05:47.352883","last_undegraded":"2024-04-25 02:05:47.352883","last_fullsized":"2024-04-25 02:05:47.352883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.372954","last_change":"2024-04-25 02:05:47.363717","last_active":"2024-04-25 02:05:47.372954","last_peered":"2024-04-25 02:05:47.372954","last_clean":"2024-04-25 02:05:47.372954","last_became_active":"2024-04-25 02:05:47.363378","last_became_peered":"2024-04-25 02:05:47.363378","last_unstale":"2024-04-25 02:05:47.372954","last_undegraded":"2024-04-25 02:05:47.372954","last_fullsized":"2024-04-25 02:05:47.372954","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377804","last_change":"2024-04-25 02:05:46.996992","last_active":"2024-04-25 02:05:47.377804","last_peered":"2024-04-25 02:05:47.377804","last_clean":"2024-04-25 02:05:47.377804","last_became_active":"2024-04-25 02:05:46.996648","last_became_peered":"2024-04-25 02:05:46.996648","last_unstale":"2024-04-25 02:05:47.377804","last_undegraded":"2024-04-25 02:05:47.377804","last_fullsized":"2024-04-25 02:05:47.377804","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389212","last_change":"2024-04-25 02:05:47.380340","last_active":"2024-04-25 02:05:47.389212","last_peered":"2024-04-25 02:05:47.389212","last_clean":"2024-04-25 02:05:47.389212","last_became_active":"2024-04-25 02:05:47.380051","last_became_peered":"2024-04-25 02:05:47.380051","last_unstale":"2024-04-25 02:05:47.389212","last_undegraded":"2024-04-25 02:05:47.389212","last_fullsized":"2024-04-25 02:05:47.389212","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351619","last_change":"2024-04-25 02:05:46.999913","last_active":"2024-04-25 02:05:47.351619","last_peered":"2024-04-25 02:05:47.351619","last_clean":"2024-04-25 02:05:47.351619","last_became_active":"2024-04-25 02:05:46.999553","last_became_peered":"2024-04-25 02:05:46.999553","last_unstale":"2024-04-25 02:05:47.351619","last_undegraded":"2024-04-25 02:05:47.351619","last_fullsized":"2024-04-25 02:05:47.351619","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384258","last_change":"2024-04-25 02:05:47.377775","last_active":"2024-04-25 02:05:47.384258","last_peered":"2024-04-25 02:05:47.384258","last_clean":"2024-04-25 02:05:47.384258","last_became_active":"2024-04-25 02:05:47.377456","last_became_peered":"2024-04-25 02:05:47.377456","last_unstale":"2024-04-25 02:05:47.384258","last_undegraded":"2024-04-25 02:05:47.384258","last_fullsized":"2024-04-25 02:05:47.384258","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389886","last_change":"2024-04-25 02:05:47.022408","last_active":"2024-04-25 02:05:47.389886","last_peered":"2024-04-25 02:05:47.389886","last_clean":"2024-04-25 02:05:47.389886","last_became_active":"2024-04-25 02:05:47.022145","last_became_peered":"2024-04-25 02:05:47.022145","last_unstale":"2024-04-25 02:05:47.389886","last_undegraded":"2024-04-25 02:05:47.389886","last_fullsized":"2024-04-25 02:05:47.389886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389273","last_change":"2024-04-25 02:05:47.383157","last_active":"2024-04-25 02:05:47.389273","last_peered":"2024-04-25 02:05:47.389273","last_clean":"2024-04-25 02:05:47.389273","last_became_active":"2024-04-25 02:05:47.382824","last_became_peered":"2024-04-25 02:05:47.382824","last_unstale":"2024-04-25 02:05:47.389273","last_undegraded":"2024-04-25 02:05:47.389273","last_fullsized":"2024-04-25 02:05:47.389273","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353638","last_change":"2024-04-25 02:05:46.999652","last_active":"2024-04-25 02:05:47.353638","last_peered":"2024-04-25 02:05:47.353638","last_clean":"2024-04-25 02:05:47.353638","last_became_active":"2024-04-25 02:05:46.999330","last_became_peered":"2024-04-25 02:05:46.999330","last_unstale":"2024-04-25 02:05:47.353638","last_undegraded":"2024-04-25 02:05:47.353638","last_fullsized":"2024-04-25 02:05:47.353638","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.382043","last_change":"2024-04-25 02:05:47.377666","last_active":"2024-04-25 02:05:47.382043","last_peered":"2024-04-25 02:05:47.382043","last_clean":"2024-04-25 02:05:47.382043","last_became_active":"2024-04-25 02:05:47.376996","last_became_peered":"2024-04-25 02:05:47.376996","last_unstale":"2024-04-25 02:05:47.382043","last_undegraded":"2024-04-25 02:05:47.382043","last_fullsized":"2024-04-25 02:05:47.382043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.361467","last_change":"2024-04-25 02:05:47.026476","last_active":"2024-04-25 02:05:47.361467","last_peered":"2024-04-25 02:05:47.361467","last_clean":"2024-04-25 02:05:47.361467","last_became_active":"2024-04-25 02:05:47.025938","last_became_peered":"2024-04-25 02:05:47.025938","last_unstale":"2024-04-25 02:05:47.361467","last_undegraded":"2024-04-25 02:05:47.361467","last_fullsized":"2024-04-25 02:05:47.361467","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.373149","last_change":"2024-04-25 02:05:47.368468","last_active":"2024-04-25 02:05:47.373149","last_peered":"2024-04-25 02:05:47.373149","last_clean":"2024-04-25 02:05:47.373149","last_became_active":"2024-04-25 02:05:47.368132","last_became_peered":"2024-04-25 02:05:47.368132","last_unstale":"2024-04-25 02:05:47.373149","last_undegraded":"2024-04-25 02:05:47.373149","last_fullsized":"2024-04-25 02:05:47.373149","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388094","last_change":"2024-04-25 02:05:47.009725","last_active":"2024-04-25 02:05:47.388094","last_peered":"2024-04-25 02:05:47.388094","last_clean":"2024-04-25 02:05:47.388094","last_became_active":"2024-04-25 02:05:47.007964","last_became_peered":"2024-04-25 02:05:47.007964","last_unstale":"2024-04-25 02:05:47.388094","last_undegraded":"2024-04-25 02:05:47.388094","last_fullsized":"2024-04-25 02:05:47.388094","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388711","last_change":"2024-04-25 02:05:47.379616","last_active":"2024-04-25 02:05:47.388711","last_peered":"2024-04-25 02:05:47.388711","last_clean":"2024-04-25 02:05:47.388711","last_became_active":"2024-04-25 02:05:47.379103","last_became_peered":"2024-04-25 02:05:47.379103","last_unstale":"2024-04-25 02:05:47.388711","last_undegraded":"2024-04-25 02:05:47.388711","last_fullsized":"2024-04-25 02:05:47.388711","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.360333","last_change":"2024-04-25 02:05:47.009452","last_active":"2024-04-25 02:05:47.360333","last_peered":"2024-04-25 02:05:47.360333","last_clean":"2024-04-25 02:05:47.360333","last_became_active":"2024-04-25 02:05:47.009116","last_became_peered":"2024-04-25 02:05:47.009116","last_unstale":"2024-04-25 02:05:47.360333","last_undegraded":"2024-04-25 02:05:47.360333","last_fullsized":"2024-04-25 02:05:47.360333","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.389963","last_change":"2024-04-25 02:05:47.386054","last_active":"2024-04-25 02:05:47.389963","last_peered":"2024-04-25 02:05:47.389963","last_clean":"2024-04-25 02:05:47.389963","last_became_active":"2024-04-25 02:05:47.383311","last_became_peered":"2024-04-25 02:05:47.383311","last_unstale":"2024-04-25 02:05:47.389963","last_undegraded":"2024-04-25 02:05:47.389963","last_fullsized":"2024-04-25 02:05:47.389963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351815","last_change":"2024-04-25 02:05:47.020004","last_active":"2024-04-25 02:05:47.351815","last_peered":"2024-04-25 02:05:47.351815","last_clean":"2024-04-25 02:05:47.351815","last_became_active":"2024-04-25 02:05:47.019687","last_became_peered":"2024-04-25 02:05:47.019687","last_unstale":"2024-04-25 02:05:47.351815","last_undegraded":"2024-04-25 02:05:47.351815","last_fullsized":"2024-04-25 02:05:47.351815","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377719","last_change":"2024-04-25 02:05:47.365437","last_active":"2024-04-25 02:05:47.377719","last_peered":"2024-04-25 02:05:47.377719","last_clean":"2024-04-25 02:05:47.377719","last_became_active":"2024-04-25 02:05:47.365101","last_became_peered":"2024-04-25 02:05:47.365101","last_unstale":"2024-04-25 02:05:47.377719","last_undegraded":"2024-04-25 02:05:47.377719","last_fullsized":"2024-04-25 02:05:47.377719","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374047","last_change":"2024-04-25 02:05:46.993531","last_active":"2024-04-25 02:05:47.374047","last_peered":"2024-04-25 02:05:47.374047","last_clean":"2024-04-25 02:05:47.374047","last_became_active":"2024-04-25 02:05:46.993117","last_became_peered":"2024-04-25 02:05:46.993117","last_unstale":"2024-04-25 02:05:47.374047","last_undegraded":"2024-04-25 02:05:47.374047","last_fullsized":"2024-04-25 02:05:47.374047","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390894","last_change":"2024-04-25 02:05:47.385729","last_active":"2024-04-25 02:05:47.390894","last_peered":"2024-04-25 02:05:47.390894","last_clean":"2024-04-25 02:05:47.390894","last_became_active":"2024-04-25 02:05:47.385421","last_became_peered":"2024-04-25 02:05:47.385421","last_unstale":"2024-04-25 02:05:47.390894","last_undegraded":"2024-04-25 02:05:47.390894","last_fullsized":"2024-04-25 02:05:47.390894","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.391988","last_change":"2024-04-25 02:05:47.020323","last_active":"2024-04-25 02:05:47.391988","last_peered":"2024-04-25 02:05:47.391988","last_clean":"2024-04-25 02:05:47.391988","last_became_active":"2024-04-25 02:05:47.019973","last_became_peered":"2024-04-25 02:05:47.019973","last_unstale":"2024-04-25 02:05:47.391988","last_undegraded":"2024-04-25 02:05:47.391988","last_fullsized":"2024-04-25 02:05:47.391988","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.384226","last_change":"2024-04-25 02:05:47.375256","last_active":"2024-04-25 02:05:47.384226","last_peered":"2024-04-25 02:05:47.384226","last_clean":"2024-04-25 02:05:47.384226","last_became_active":"2024-04-25 02:05:47.374920","last_became_peered":"2024-04-25 02:05:47.374920","last_unstale":"2024-04-25 02:05:47.384226","last_undegraded":"2024-04-25 02:05:47.384226","last_fullsized":"2024-04-25 02:05:47.384226","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353210","last_change":"2024-04-25 02:05:46.995620","last_active":"2024-04-25 02:05:47.353210","last_peered":"2024-04-25 02:05:47.353210","last_clean":"2024-04-25 02:05:47.353210","last_became_active":"2024-04-25 02:05:46.995117","last_became_peered":"2024-04-25 02:05:46.995117","last_unstale":"2024-04-25 02:05:47.353210","last_undegraded":"2024-04-25 02:05:47.353210","last_fullsized":"2024-04-25 02:05:47.353210","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.374027","last_change":"2024-04-25 02:05:47.372331","last_active":"2024-04-25 02:05:47.374027","last_peered":"2024-04-25 02:05:47.374027","last_clean":"2024-04-25 02:05:47.374027","last_became_active":"2024-04-25 02:05:47.372004","last_became_peered":"2024-04-25 02:05:47.372004","last_unstale":"2024-04-25 02:05:47.374027","last_undegraded":"2024-04-25 02:05:47.374027","last_fullsized":"2024-04-25 02:05:47.374027","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353418","last_change":"2024-04-25 02:05:46.999650","last_active":"2024-04-25 02:05:47.353418","last_peered":"2024-04-25 02:05:47.353418","last_clean":"2024-04-25 02:05:47.353418","last_became_active":"2024-04-25 02:05:46.999284","last_became_peered":"2024-04-25 02:05:46.999284","last_unstale":"2024-04-25 02:05:47.353418","last_undegraded":"2024-04-25 02:05:47.353418","last_fullsized":"2024-04-25 02:05:47.353418","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386278","last_change":"2024-04-25 02:05:47.380781","last_active":"2024-04-25 02:05:47.386278","last_peered":"2024-04-25 02:05:47.386278","last_clean":"2024-04-25 02:05:47.386278","last_became_active":"2024-04-25 02:05:47.380462","last_became_peered":"2024-04-25 02:05:47.380462","last_unstale":"2024-04-25 02:05:47.386278","last_undegraded":"2024-04-25 02:05:47.386278","last_fullsized":"2024-04-25 02:05:47.386278","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362868","last_change":"2024-04-25 02:05:47.001836","last_active":"2024-04-25 02:05:47.362868","last_peered":"2024-04-25 02:05:47.362868","last_clean":"2024-04-25 02:05:47.362868","last_became_active":"2024-04-25 02:05:47.001509","last_became_peered":"2024-04-25 02:05:47.001509","last_unstale":"2024-04-25 02:05:47.362868","last_undegraded":"2024-04-25 02:05:47.362868","last_fullsized":"2024-04-25 02:05:47.362868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.383697","last_change":"2024-04-25 02:05:47.373785","last_active":"2024-04-25 02:05:47.383697","last_peered":"2024-04-25 02:05:47.383697","last_clean":"2024-04-25 02:05:47.383697","last_became_active":"2024-04-25 02:05:47.371646","last_became_peered":"2024-04-25 02:05:47.371646","last_unstale":"2024-04-25 02:05:47.383697","last_undegraded":"2024-04-25 02:05:47.383697","last_fullsized":"2024-04-25 02:05:47.383697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.359221","last_change":"2024-04-25 02:05:47.009028","last_active":"2024-04-25 02:05:47.359221","last_peered":"2024-04-25 02:05:47.359221","last_clean":"2024-04-25 02:05:47.359221","last_became_active":"2024-04-25 02:05:47.007728","last_became_peered":"2024-04-25 02:05:47.007728","last_unstale":"2024-04-25 02:05:47.359221","last_undegraded":"2024-04-25 02:05:47.359221","last_fullsized":"2024-04-25 02:05:47.359221","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390062","last_change":"2024-04-25 02:05:47.386599","last_active":"2024-04-25 02:05:47.390062","last_peered":"2024-04-25 02:05:47.390062","last_clean":"2024-04-25 02:05:47.390062","last_became_active":"2024-04-25 02:05:47.383052","last_became_peered":"2024-04-25 02:05:47.383052","last_unstale":"2024-04-25 02:05:47.390062","last_undegraded":"2024-04-25 02:05:47.390062","last_fullsized":"2024-04-25 02:05:47.390062","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.351457","last_change":"2024-04-25 02:05:46.992970","last_active":"2024-04-25 02:05:47.351457","last_peered":"2024-04-25 02:05:47.351457","last_clean":"2024-04-25 02:05:47.351457","last_became_active":"2024-04-25 02:05:46.992580","last_became_peered":"2024-04-25 02:05:46.992580","last_unstale":"2024-04-25 02:05:47.351457","last_undegraded":"2024-04-25 02:05:47.351457","last_fullsized":"2024-04-25 02:05:47.351457","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390594","last_change":"2024-04-25 02:05:47.384947","last_active":"2024-04-25 02:05:47.390594","last_peered":"2024-04-25 02:05:47.390594","last_clean":"2024-04-25 02:05:47.390594","last_became_active":"2024-04-25 02:05:47.384477","last_became_peered":"2024-04-25 02:05:47.384477","last_unstale":"2024-04-25 02:05:47.390594","last_undegraded":"2024-04-25 02:05:47.390594","last_fullsized":"2024-04-25 02:05:47.390594","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390564","last_change":"2024-04-25 02:05:47.016029","last_active":"2024-04-25 02:05:47.390564","last_peered":"2024-04-25 02:05:47.390564","last_clean":"2024-04-25 02:05:47.390564","last_became_active":"2024-04-25 02:05:47.015470","last_became_peered":"2024-04-25 02:05:47.015470","last_unstale":"2024-04-25 02:05:47.390564","last_undegraded":"2024-04-25 02:05:47.390564","last_fullsized":"2024-04-25 02:05:47.390564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.377970","last_change":"2024-04-25 02:05:47.368583","last_active":"2024-04-25 02:05:47.377970","last_peered":"2024-04-25 02:05:47.377970","last_clean":"2024-04-25 02:05:47.377970","last_became_active":"2024-04-25 02:05:47.366798","last_became_peered":"2024-04-25 02:05:47.366798","last_unstale":"2024-04-25 02:05:47.377970","last_undegraded":"2024-04-25 02:05:47.377970","last_fullsized":"2024-04-25 02:05:47.377970","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388229","last_change":"2024-04-25 02:05:47.005838","last_active":"2024-04-25 02:05:47.388229","last_peered":"2024-04-25 02:05:47.388229","last_clean":"2024-04-25 02:05:47.388229","last_became_active":"2024-04-25 02:05:47.005500","last_became_peered":"2024-04-25 02:05:47.005500","last_unstale":"2024-04-25 02:05:47.388229","last_undegraded":"2024-04-25 02:05:47.388229","last_fullsized":"2024-04-25 02:05:47.388229","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.386313","last_change":"2024-04-25 02:05:47.380789","last_active":"2024-04-25 02:05:47.386313","last_peered":"2024-04-25 02:05:47.386313","last_clean":"2024-04-25 02:05:47.386313","last_became_active":"2024-04-25 02:05:47.380537","last_became_peered":"2024-04-25 02:05:47.380537","last_unstale":"2024-04-25 02:05:47.386313","last_undegraded":"2024-04-25 02:05:47.386313","last_fullsized":"2024-04-25 02:05:47.386313","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.388104","last_change":"2024-04-25 02:05:47.006598","last_active":"2024-04-25 02:05:47.388104","last_peered":"2024-04-25 02:05:47.388104","last_clean":"2024-04-25 02:05:47.388104","last_became_active":"2024-04-25 02:05:47.006139","last_became_peered":"2024-04-25 02:05:47.006139","last_unstale":"2024-04-25 02:05:47.388104","last_undegraded":"2024-04-25 02:05:47.388104","last_fullsized":"2024-04-25 02:05:47.388104","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.378165","last_change":"2024-04-25 02:05:47.374238","last_active":"2024-04-25 02:05:47.378165","last_peered":"2024-04-25 02:05:47.378165","last_clean":"2024-04-25 02:05:47.378165","last_became_active":"2024-04-25 02:05:47.373927","last_became_peered":"2024-04-25 02:05:47.373927","last_unstale":"2024-04-25 02:05:47.378165","last_undegraded":"2024-04-25 02:05:47.378165","last_fullsized":"2024-04-25 02:05:47.378165","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.353045","last_change":"2024-04-25 02:05:47.003496","last_active":"2024-04-25 02:05:47.353045","last_peered":"2024-04-25 02:05:47.353045","last_clean":"2024-04-25 02:05:47.353045","last_became_active":"2024-04-25 02:05:47.002906","last_became_peered":"2024-04-25 02:05:47.002906","last_unstale":"2024-04-25 02:05:47.353045","last_undegraded":"2024-04-25 02:05:47.353045","last_fullsized":"2024-04-25 02:05:47.353045","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.390790","last_change":"2024-04-25 02:05:47.385923","last_active":"2024-04-25 02:05:47.390790","last_peered":"2024-04-25 02:05:47.390790","last_clean":"2024-04-25 02:05:47.390790","last_became_active":"2024-04-25 02:05:47.385607","last_became_peered":"2024-04-25 02:05:47.385607","last_unstale":"2024-04-25 02:05:47.390790","last_undegraded":"2024-04-25 02:05:47.390790","last_fullsized":"2024-04-25 02:05:47.390790","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.362831","last_change":"2024-04-25 02:05:46.999151","last_active":"2024-04-25 02:05:47.362831","last_peered":"2024-04-25 02:05:47.362831","last_clean":"2024-04-25 02:05:47.362831","last_became_active":"2024-04-25 02:05:46.998843","last_became_peered":"2024-04-25 02:05:46.998843","last_unstale":"2024-04-25 02:05:47.362831","last_undegraded":"2024-04-25 02:05:47.362831","last_fullsized":"2024-04-25 02:05:47.362831","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.387468","last_change":"2024-04-25 02:05:47.381229","last_active":"2024-04-25 02:05:47.387468","last_peered":"2024-04-25 02:05:47.387468","last_clean":"2024-04-25 02:05:47.387468","last_became_active":"2024-04-25 02:05:47.380920","last_became_peered":"2024-04-25 02:05:47.380920","last_unstale":"2024-04-25 02:05:47.387468","last_undegraded":"2024-04-25 02:05:47.387468","last_fullsized":"2024-04-25 02:05:47.387468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:46.957580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:46.957580","last_clean_scrub_stamp":"2024-04-25 02:05:46.957580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2024-04-25 02:05:47.385052","last_change":"2024-04-25 02:05:47.002796","last_active":"2024-04-25 02:05:47.385052","last_peered":"2024-04-25 02:05:47.385052","last_clean":"2024-04-25 02:05:47.385052","last_became_active":"2024-04-25 02:05:47.002460","last_became_peered":"2024-04-25 02:05:47.002460","last_unstale":"2024-04-25 02:05:47.385052","last_undegraded":"2024-04-25 02:05:47.385052","last_fullsized":"2024-04-25 02:05:47.385052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:45.951812","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:45.951812","last_clean_scrub_stamp":"2024-04-25 02:05:45.951812","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":40772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":39936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]}]}]}} 2024-04-25T02:05:58.497 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:05:58.497 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:05:58.497 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:05:58.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.658 7f0eac4dd700 1 Processor -- start 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.658 7f0eac4dd700 1 -- start start 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0eac4dd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ea40f58a0 0x7f0ea40f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0eac4dd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea40f1e40 0x7f0ea410e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0eac4dd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea40f91b0 con 0x7f0ea40f2290 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0eac4dd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea410f060 con 0x7f0ea40f58a0 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0eac4dd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea41ac600 con 0x7f0ea40f1e40 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea92d8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ea40f58a0 0x7f0ea40f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea8ad7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea40f1e40 0x7f0ea410e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea8ad7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea40f1e40 0x7f0ea410e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40018/0 (socket says 172.21.15.57:40018) 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea92d8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ea40f58a0 0x7f0ea40f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60808/0 (socket says 172.21.15.57:60808) 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea8ad7700 1 -- 172.21.15.57:0/2842961678 learned_addr learned my addr 172.21.15.57:0/2842961678 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea9ad9700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0ea40f2290 0x7f0ea410e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46824/0 (socket says 172.21.15.57:46824) 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea8ad7700 1 -- 172.21.15.57:0/2842961678 >> v2:172.21.15.57:3300/0 conn(0x7f0ea40f58a0 msgr2=0x7f0ea40f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea8ad7700 1 --2- 172.21.15.57:0/2842961678 >> v2:172.21.15.57:3300/0 conn(0x7f0ea40f58a0 0x7f0ea40f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0e97fff700 1 -- 172.21.15.57:0/2842961678 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024451941 0 0) 0x7f0e9c001490 con 0x7f0ea40f2290 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea8ad7700 1 -- 172.21.15.57:0/2842961678 >> v1:172.21.15.57:6789/0 conn(0x7f0ea40f2290 legacy=0x7f0ea410e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea8ad7700 1 -- 172.21.15.57:0/2842961678 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea41ac7b0 con 0x7f0ea40f1e40 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0ea8ad7700 1 --2- 172.21.15.57:0/2842961678 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea40f1e40 0x7f0ea410e230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0e98002f70 tx=0x7f0e980099d0).ready entity=mon.2 client_cookie=4fd3f2cc88842d18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.659 7f0e97fff700 1 -- 172.21.15.57:0/2842961678 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ea41ac7b0 con 0x7f0ea40f1e40 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0e97fff700 1 -- 172.21.15.57:0/2842961678 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9800f510 con 0x7f0ea40f1e40 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0e97fff700 1 -- 172.21.15.57:0/2842961678 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e9800f6f0 con 0x7f0ea40f1e40 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0eac4dd700 1 -- 172.21.15.57:0/2842961678 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea40f1e40 msgr2=0x7f0ea410e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0eac4dd700 1 --2- 172.21.15.57:0/2842961678 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea40f1e40 0x7f0ea410e230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0e98002f70 tx=0x7f0e980099d0).stop 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0eac4dd700 1 -- 172.21.15.57:0/2842961678 shutdown_connections 2024-04-25T02:05:58.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0eac4dd700 1 --2- 172.21.15.57:0/2842961678 >> v2:172.21.15.57:3300/0 conn(0x7f0ea40f58a0 0x7f0ea40f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0eac4dd700 1 --2- 172.21.15.57:0/2842961678 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea40f1e40 0x7f0ea410e230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0eac4dd700 1 -- 172.21.15.57:0/2842961678 >> 172.21.15.57:0/2842961678 conn(0x7f0ea41139f0 msgr2=0x7f0ea40f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:58.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0eac4dd700 1 -- 172.21.15.57:0/2842961678 shutdown_connections 2024-04-25T02:05:58.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.660 7f0eac4dd700 1 -- 172.21.15.57:0/2842961678 wait complete. 2024-04-25T02:05:58.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.684 7f0eac4dd700 1 Processor -- start 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.684 7f0eac4dd700 1 -- start start 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.684 7f0eac4dd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ea40da440 0x7f0ea40da890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.684 7f0eac4dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ea40daec0 0x7f0ea41b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0eac4dd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea41b4e60 0x7f0ea41bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0eac4dd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40e2f60 con 0x7f0ea40daec0 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0eac4dd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40d77e0 con 0x7f0ea40da440 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0eac4dd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40d8520 con 0x7f0ea41b4e60 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea92d8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ea40da440 0x7f0ea40da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea8ad7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ea40daec0 0x7f0ea41b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea92d8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ea40da440 0x7f0ea40da890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47746/0 (socket says 172.21.15.57:47746) 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea92d8700 1 -- 172.21.15.57:0/391081832 learned_addr learned my addr 172.21.15.57:0/391081832 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea9ad9700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea41b4e60 0x7f0ea41bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea8ad7700 1 -- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea41b4e60 msgr2=0x7f0ea41bbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea8ad7700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea41b4e60 0x7f0ea41bbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea8ad7700 1 -- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ea40da440 msgr2=0x7f0ea40da890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea8ad7700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ea40da440 0x7f0ea40da890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea8ad7700 1 -- 172.21.15.57:0/391081832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea40d6ac0 con 0x7f0ea40daec0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea92d8700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ea40da440 0x7f0ea40da890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0ea8ad7700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ea40daec0 0x7f0ea41b4830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0ea40d99e0 tx=0x7f0e980068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0e967fc700 1 -- 172.21.15.57:0/391081832 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ea40d6ac0 con 0x7f0ea40daec0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0e967fc700 1 -- 172.21.15.57:0/391081832 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98011690 con 0x7f0ea40daec0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea40d7300 con 0x7f0ea40daec0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.685 7f0e967fc700 1 -- 172.21.15.57:0/391081832 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e98011a60 con 0x7f0ea40daec0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.686 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea41b5490 con 0x7f0ea40daec0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.686 7f0e967fc700 1 -- 172.21.15.57:0/391081832 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0e98011c60 con 0x7f0ea40daec0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.686 7f0e967fc700 1 -- 172.21.15.57:0/391081832 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f0e98001790 con 0x7f0ea40daec0 2024-04-25T02:05:58.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.687 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea40f0860 con 0x7f0ea40daec0 2024-04-25T02:05:58.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.690 7f0e967fc700 1 -- 172.21.15.57:0/391081832 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f0e98011480 con 0x7f0ea40daec0 2024-04-25T02:05:58.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.836 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0ea40d7c90 con 0x7f0ea40daec0 2024-04-25T02:05:58.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.836 7f0e967fc700 1 -- 172.21.15.57:0/391081832 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+34 (secure 0 0 0) 0x7f0e9800f300 con 0x7f0ea40daec0 2024-04-25T02:05:58.842 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.837 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 >> v1:172.21.15.57:6816/43033 conn(0x7f0e840145b0 legacy=0x7f0e84016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.837 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ea40daec0 msgr2=0x7f0ea41b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.837 7f0eac4dd700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ea40daec0 0x7f0ea41b4830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0ea40d99e0 tx=0x7f0e980068c0).stop 2024-04-25T02:05:58.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.837 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 shutdown_connections 2024-04-25T02:05:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.837 7f0eac4dd700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ea41b4e60 0x7f0ea41bbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.837 7f0eac4dd700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ea40da440 0x7f0ea40da890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.837 7f0eac4dd700 1 --2- 172.21.15.57:0/391081832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ea40daec0 0x7f0ea41b4830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.837 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 >> 172.21.15.57:0/391081832 conn(0x7f0ea40dc840 msgr2=0x7f0ea40d8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.838 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 shutdown_connections 2024-04-25T02:05:58.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.838 7f0eac4dd700 1 -- 172.21.15.57:0/391081832 wait complete. 2024-04-25T02:05:58.854 INFO:teuthology.orchestra.run.smithi057.stdout:{"checks":{},"status":"HEALTH_OK"} 2024-04-25T02:05:58.854 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:05:58.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:05:58.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59b2993700 1 Processor -- start 2024-04-25T02:05:58.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59b2993700 1 -- start start 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59b2993700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0f5920 0x7f59ac10c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59b2993700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac10c970 0x7f59ac0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59b2993700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ac0f26c0 con 0x7f59ac10cdc0 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59b2993700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac0fa290 con 0x7f59ac10c970 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59b2993700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac0f95c0 con 0x7f59ac0f5920 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59aadea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac10c970 0x7f59ac0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59ab5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0f5920 0x7f59ac10c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59aadea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac10c970 0x7f59ac0f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47748/0 (socket says 172.21.15.57:47748) 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59aadea700 1 -- 172.21.15.57:0/2589105538 learned_addr learned my addr 172.21.15.57:0/2589105538 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59ab5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0f5920 0x7f59ac10c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40036/0 (socket says 172.21.15.57:40036) 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.980 7f59abdec700 1 --1- 172.21.15.57:0/2589105538 >> v1:172.21.15.57:6789/0 conn(0x7f59ac10cdc0 0x7f59ac0f1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46830/0 (socket says 172.21.15.57:46830) 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59ab5eb700 1 -- 172.21.15.57:0/2589105538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac10c970 msgr2=0x7f59ac0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59ab5eb700 1 --2- 172.21.15.57:0/2589105538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac10c970 0x7f59ac0f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59aa5e9700 1 -- 172.21.15.57:0/2589105538 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642522017 0 0) 0x7f59a4001490 con 0x7f59ac10cdc0 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59ab5eb700 1 -- 172.21.15.57:0/2589105538 >> v1:172.21.15.57:6789/0 conn(0x7f59ac10cdc0 legacy=0x7f59ac0f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59ab5eb700 1 -- 172.21.15.57:0/2589105538 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac1aa5e0 con 0x7f59ac0f5920 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59aadea700 1 --2- 172.21.15.57:0/2589105538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac10c970 0x7f59ac0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59ab5eb700 1 --2- 172.21.15.57:0/2589105538 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0f5920 0x7f59ac10c340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f599c002f70 tx=0x7f599c00b9a0).ready entity=mon.2 client_cookie=2fdc60af1b2e33fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59aa5e9700 1 -- 172.21.15.57:0/2589105538 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59ac1aa5e0 con 0x7f59ac0f5920 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59aa5e9700 1 -- 172.21.15.57:0/2589105538 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00d570 con 0x7f59ac0f5920 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59aa5e9700 1 -- 172.21.15.57:0/2589105538 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f599c00d940 con 0x7f59ac0f5920 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59b2993700 1 -- 172.21.15.57:0/2589105538 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0f5920 msgr2=0x7f59ac10c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.981 7f59b2993700 1 --2- 172.21.15.57:0/2589105538 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0f5920 0x7f59ac10c340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f599c002f70 tx=0x7f599c00b9a0).stop 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.982 7f59b2993700 1 -- 172.21.15.57:0/2589105538 shutdown_connections 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.982 7f59b2993700 1 --2- 172.21.15.57:0/2589105538 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0f5920 0x7f59ac10c340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.982 7f59b2993700 1 --2- 172.21.15.57:0/2589105538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac10c970 0x7f59ac0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.982 7f59b2993700 1 -- 172.21.15.57:0/2589105538 >> 172.21.15.57:0/2589105538 conn(0x7f59ac113a70 msgr2=0x7f59ac0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.982 7f59b2993700 1 -- 172.21.15.57:0/2589105538 shutdown_connections 2024-04-25T02:05:58.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:58.982 7f59b2993700 1 -- 172.21.15.57:0/2589105538 wait complete. 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59b2993700 1 Processor -- start 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59b2993700 1 -- start start 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59b2993700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0d5450 0x7f59ac0d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59b2993700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59ac0d5ed0 0x7f59ac1b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59b2993700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac1b2910 0x7f59ac1b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59b2993700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac0f0110 con 0x7f59ac0d5ed0 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59b2993700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac0c4a70 con 0x7f59ac1b2910 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59b2993700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac1b3390 con 0x7f59ac0d5450 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59ab5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0d5450 0x7f59ac0d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59abdec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac1b2910 0x7f59ac1b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59aadea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59ac0d5ed0 0x7f59ac1b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59ab5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0d5450 0x7f59ac0d58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40052/0 (socket says 172.21.15.57:40052) 2024-04-25T02:05:59.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.006 7f59ab5eb700 1 -- 172.21.15.57:0/1415106544 learned_addr learned my addr 172.21.15.57:0/1415106544 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59ab5eb700 1 -- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac1b2910 msgr2=0x7f59ac1b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59ab5eb700 1 --2- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac1b2910 0x7f59ac1b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59ab5eb700 1 -- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59ac0d5ed0 msgr2=0x7f59ac1b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59ab5eb700 1 --2- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59ac0d5ed0 0x7f59ac1b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59ab5eb700 1 -- 172.21.15.57:0/1415106544 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac1a4b30 con 0x7f59ac0d5450 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59aadea700 1 --2- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59ac0d5ed0 0x7f59ac1b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59ab5eb700 1 --2- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0d5450 0x7f59ac0d58a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f59ac0c53d0 tx=0x7f599c0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59a8de6700 1 -- 172.21.15.57:0/1415106544 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59ac1a4b30 con 0x7f59ac0d5450 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59a8de6700 1 -- 172.21.15.57:0/1415106544 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c0117e0 con 0x7f59ac0d5450 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59a8de6700 1 -- 172.21.15.57:0/1415106544 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f599c022020 con 0x7f59ac0d5450 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59b2993700 1 -- 172.21.15.57:0/1415106544 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ac1a45b0 con 0x7f59ac0d5450 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59b2993700 1 -- 172.21.15.57:0/1415106544 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ac1b9bb0 con 0x7f59ac0d5450 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.007 7f59a8de6700 1 -- 172.21.15.57:0/1415106544 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f599c011bb0 con 0x7f59ac0d5450 2024-04-25T02:05:59.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.008 7f59a8de6700 1 -- 172.21.15.57:0/1415106544 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f599c00c770 con 0x7f59ac0d5450 2024-04-25T02:05:59.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.008 7f59b2993700 1 -- 172.21.15.57:0/1415106544 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ac0f08e0 con 0x7f59ac0d5450 2024-04-25T02:05:59.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.011 7f59a8de6700 1 -- 172.21.15.57:0/1415106544 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f599c0115d0 con 0x7f59ac0d5450 2024-04-25T02:05:59.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.123 7f59b2993700 1 -- 172.21.15.57:0/1415106544 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59ac1aca00 con 0x7f59ac0d5450 2024-04-25T02:05:59.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.123 7f59a8de6700 1 -- 172.21.15.57:0/1415106544 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7f599c00d360 con 0x7f59ac0d5450 2024-04-25T02:05:59.129 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:05:59.129 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:48.339447","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:05:59.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 -- 172.21.15.57:0/1415106544 >> v1:172.21.15.57:6816/43033 conn(0x7f59900145b0 legacy=0x7f5990016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 -- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0d5450 msgr2=0x7f59ac0d58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 --2- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0d5450 0x7f59ac0d58a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f59ac0c53d0 tx=0x7f599c0068c0).stop 2024-04-25T02:05:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 -- 172.21.15.57:0/1415106544 shutdown_connections 2024-04-25T02:05:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 --2- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59ac1b2910 0x7f59ac1b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 --2- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59ac0d5450 0x7f59ac0d58a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 --2- 172.21.15.57:0/1415106544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59ac0d5ed0 0x7f59ac1b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 -- 172.21.15.57:0/1415106544 >> 172.21.15.57:0/1415106544 conn(0x7f59ac0c5990 msgr2=0x7f59ac0d6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 -- 172.21.15.57:0/1415106544 shutdown_connections 2024-04-25T02:05:59.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.125 7f59b2993700 1 -- 172.21.15.57:0/1415106544 wait complete. 2024-04-25T02:05:59.141 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:05:59.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:05:59.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.269 7f7d70fc2700 1 Processor -- start 2024-04-25T02:05:59.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d70fc2700 1 -- start start 2024-04-25T02:05:59.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d70fc2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0f5990 0x7f7d6c10b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d70fc2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d6c10bb10 0x7f7d6c1a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d70fc2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6c1a09f0 con 0x7f7d6c10b6c0 2024-04-25T02:05:59.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d70fc2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6c0fa510 con 0x7f7d6c10bb10 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d70fc2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c1a0c10 con 0x7f7d6c0f5990 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d69d9f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0f5990 0x7f7d6c10b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d6a5a0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d6c10bb10 0x7f7d6c1a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d69d9f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0f5990 0x7f7d6c10b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40056/0 (socket says 172.21.15.57:40056) 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d69d9f700 1 -- 172.21.15.57:0/2099758092 learned_addr learned my addr 172.21.15.57:0/2099758092 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.270 7f7d6a5a0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d6c10bb10 0x7f7d6c1a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60828/0 (socket says 172.21.15.57:60828) 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d69d9f700 1 -- 172.21.15.57:0/2099758092 >> v2:172.21.15.57:3300/0 conn(0x7f7d6c10bb10 msgr2=0x7f7d6c1a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d69d9f700 1 --2- 172.21.15.57:0/2099758092 >> v2:172.21.15.57:3300/0 conn(0x7f7d6c10bb10 0x7f7d6c1a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d69d9f700 1 -- 172.21.15.57:0/2099758092 >> v1:172.21.15.57:6789/0 conn(0x7f7d6c10b6c0 legacy=0x7f7d6c19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d6959e700 1 -- 172.21.15.57:0/2099758092 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283421315 0 0) 0x7f7d54001110 con 0x7f7d6c10b6c0 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d69d9f700 1 -- 172.21.15.57:0/2099758092 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c1a9350 con 0x7f7d6c0f5990 2024-04-25T02:05:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d6a5a0700 1 --2- 172.21.15.57:0/2099758092 >> v2:172.21.15.57:3300/0 conn(0x7f7d6c10bb10 0x7f7d6c1a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d69d9f700 1 --2- 172.21.15.57:0/2099758092 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0f5990 0x7f7d6c10b090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7d5c002f70 tx=0x7f7d5c0099d0).ready entity=mon.2 client_cookie=8efead8aa86e67c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d6959e700 1 -- 172.21.15.57:0/2099758092 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d6c1a9350 con 0x7f7d6c0f5990 2024-04-25T02:05:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d6959e700 1 -- 172.21.15.57:0/2099758092 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c00f510 con 0x7f7d6c0f5990 2024-04-25T02:05:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d6959e700 1 -- 172.21.15.57:0/2099758092 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d5c00f6f0 con 0x7f7d6c0f5990 2024-04-25T02:05:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d70fc2700 1 -- 172.21.15.57:0/2099758092 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0f5990 msgr2=0x7f7d6c10b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.271 7f7d70fc2700 1 --2- 172.21.15.57:0/2099758092 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0f5990 0x7f7d6c10b090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7d5c002f70 tx=0x7f7d5c0099d0).stop 2024-04-25T02:05:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.272 7f7d70fc2700 1 -- 172.21.15.57:0/2099758092 shutdown_connections 2024-04-25T02:05:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.272 7f7d70fc2700 1 --2- 172.21.15.57:0/2099758092 >> v2:172.21.15.57:3300/0 conn(0x7f7d6c10bb10 0x7f7d6c1a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.272 7f7d70fc2700 1 --2- 172.21.15.57:0/2099758092 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0f5990 0x7f7d6c10b090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.272 7f7d70fc2700 1 -- 172.21.15.57:0/2099758092 >> 172.21.15.57:0/2099758092 conn(0x7f7d6c1139f0 msgr2=0x7f7d6c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.272 7f7d70fc2700 1 -- 172.21.15.57:0/2099758092 shutdown_connections 2024-04-25T02:05:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.272 7f7d70fc2700 1 -- 172.21.15.57:0/2099758092 wait complete. 2024-04-25T02:05:59.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d70fc2700 1 Processor -- start 2024-04-25T02:05:59.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d70fc2700 1 -- start start 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d70fc2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d6c1ab760 0x7f7d6c1abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d70fc2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d6c1ac1e0 0x7f7d6c0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d70fc2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0d0c50 0x7f7d6c1b9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d70fc2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0bb070 con 0x7f7d6c1ac1e0 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d70fc2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0d1d80 con 0x7f7d6c1ab760 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d70fc2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0d2590 con 0x7f7d6c0d0c50 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d6159e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d6c1ac1e0 0x7f7d6c0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d6a5a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0d0c50 0x7f7d6c1b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d69d9f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d6c1ab760 0x7f7d6c1abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d6159e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d6c1ac1e0 0x7f7d6c0d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60838/0 (socket says 172.21.15.57:60838) 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d6a5a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0d0c50 0x7f7d6c1b9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40072/0 (socket says 172.21.15.57:40072) 2024-04-25T02:05:59.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d6159e700 1 -- 172.21.15.57:0/747433758 learned_addr learned my addr 172.21.15.57:0/747433758 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d69d9f700 1 -- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0d0c50 msgr2=0x7f7d6c1b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d69d9f700 1 --2- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0d0c50 0x7f7d6c1b9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d69d9f700 1 -- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d6c1ac1e0 msgr2=0x7f7d6c0d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d69d9f700 1 --2- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d6c1ac1e0 0x7f7d6c0d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.296 7f7d69d9f700 1 -- 172.21.15.57:0/747433758 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c0c52d0 con 0x7f7d6c1ab760 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d6a5a0700 1 --2- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0d0c50 0x7f7d6c1b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d69d9f700 1 --2- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d6c1ab760 0x7f7d6c1abbb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7d6c0d83f0 tx=0x7f7d5c0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d637fe700 1 -- 172.21.15.57:0/747433758 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d6c0c52d0 con 0x7f7d6c1ab760 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d637fe700 1 -- 172.21.15.57:0/747433758 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c0119c0 con 0x7f7d6c1ab760 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d637fe700 1 -- 172.21.15.57:0/747433758 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d5c011d90 con 0x7f7d6c1ab760 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c0d10a0 con 0x7f7d6c1ab760 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c1a9550 con 0x7f7d6c1ab760 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d637fe700 1 -- 172.21.15.57:0/747433758 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7d5c027460 con 0x7f7d6c1ab760 2024-04-25T02:05:59.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.297 7f7d637fe700 1 -- 172.21.15.57:0/747433758 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7d5c020c20 con 0x7f7d6c1ab760 2024-04-25T02:05:59.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.298 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6c0f0860 con 0x7f7d6c1ab760 2024-04-25T02:05:59.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.301 7f7d637fe700 1 -- 172.21.15.57:0/747433758 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7d5c0117b0 con 0x7f7d6c1ab760 2024-04-25T02:05:59.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.413 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d6c0a61a0 con 0x7f7d6c1ab760 2024-04-25T02:05:59.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.413 7f7d637fe700 1 -- 172.21.15.57:0/747433758 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d5c00f300 con 0x7f7d6c1ab760 2024-04-25T02:05:59.419 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:05:59.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 >> v1:172.21.15.57:6816/43033 conn(0x7f7d500145b0 legacy=0x7f7d50016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d6c1ab760 msgr2=0x7f7d6c1abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 --2- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d6c1ab760 0x7f7d6c1abbb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7d6c0d83f0 tx=0x7f7d5c0068c0).stop 2024-04-25T02:05:59.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 shutdown_connections 2024-04-25T02:05:59.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 --2- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d6c0d0c50 0x7f7d6c1b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 --2- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d6c1ab760 0x7f7d6c1abbb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 --2- 172.21.15.57:0/747433758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d6c1ac1e0 0x7f7d6c0d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 >> 172.21.15.57:0/747433758 conn(0x7f7d6c0c5920 msgr2=0x7f7d6c0d7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 shutdown_connections 2024-04-25T02:05:59.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.414 7f7d70fc2700 1 -- 172.21.15.57:0/747433758 wait complete. 2024-04-25T02:05:59.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.559 7f90b9bbe700 1 Processor -- start 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.559 7f90b9bbe700 1 -- start start 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.559 7f90b9bbe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90b40f5a10 0x7f90b410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.559 7f90b9bbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b410b740 0x7f90b419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.559 7f90b9bbe700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b41a0a70 con 0x7f90b410bb90 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b9bbe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b40fa590 con 0x7f90b40f5a10 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b9bbe700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41a0c90 con 0x7f90b410b740 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b285d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90b40f5a10 0x7f90b410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b305e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f90b410bb90 0x7f90b41a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46840/0 (socket says 172.21.15.57:46840) 2024-04-25T02:05:59.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b305e700 1 -- 172.21.15.57:0/3998536508 learned_addr learned my addr 172.21.15.57:0/3998536508 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90abfff700 1 --2- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b410b740 0x7f90b419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b285d700 1 -- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b410b740 msgr2=0x7f90b419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b285d700 1 --2- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b410b740 0x7f90b419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b285d700 1 -- 172.21.15.57:0/3998536508 >> v1:172.21.15.57:6789/0 conn(0x7f90b410bb90 legacy=0x7f90b41a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b205c700 1 -- 172.21.15.57:0/3998536508 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414850771 0 0) 0x7f90ac001490 con 0x7f90b410bb90 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b285d700 1 -- 172.21.15.57:0/3998536508 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b41a93d0 con 0x7f90b40f5a10 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90abfff700 1 --2- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b410b740 0x7f90b419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b285d700 1 --2- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b40f5a10 0x7f90b410b110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f90b410f920 tx=0x7f90a400ba20).ready entity=mon.0 client_cookie=21e9ca71f02d3f64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b205c700 1 -- 172.21.15.57:0/3998536508 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90b41a93d0 con 0x7f90b40f5a10 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b205c700 1 -- 172.21.15.57:0/3998536508 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a400d5c0 con 0x7f90b40f5a10 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b205c700 1 -- 172.21.15.57:0/3998536508 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90a400d990 con 0x7f90b40f5a10 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b9bbe700 1 -- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b40f5a10 msgr2=0x7f90b410b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.560 7f90b9bbe700 1 --2- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b40f5a10 0x7f90b410b110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f90b410f920 tx=0x7f90a400ba20).stop 2024-04-25T02:05:59.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.561 7f90b9bbe700 1 -- 172.21.15.57:0/3998536508 shutdown_connections 2024-04-25T02:05:59.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.561 7f90b9bbe700 1 --2- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b40f5a10 0x7f90b410b110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.561 7f90b9bbe700 1 --2- 172.21.15.57:0/3998536508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b410b740 0x7f90b419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.561 7f90b9bbe700 1 -- 172.21.15.57:0/3998536508 >> 172.21.15.57:0/3998536508 conn(0x7f90b4113a70 msgr2=0x7f90b40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:59.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.561 7f90b9bbe700 1 -- 172.21.15.57:0/3998536508 shutdown_connections 2024-04-25T02:05:59.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.561 7f90b9bbe700 1 -- 172.21.15.57:0/3998536508 wait complete. 2024-04-25T02:05:59.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.585 7f90b9bbe700 1 Processor -- start 2024-04-25T02:05:59.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.585 7f90b9bbe700 1 -- start start 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.585 7f90b9bbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90b40d58e0 0x7f90b40d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b9bbe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b41b10a0 0x7f90b41b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b9bbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b41b1b20 0x7f90b41b8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b9bbe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40e29d0 con 0x7f90b41b10a0 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b9bbe700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41a44c0 con 0x7f90b40d58e0 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b9bbe700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40d6360 con 0x7f90b41b1b20 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b41b10a0 0x7f90b41b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b285d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90b40d58e0 0x7f90b40d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b305e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b41b1b20 0x7f90b41b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b41b10a0 0x7f90b41b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60866/0 (socket says 172.21.15.57:60866) 2024-04-25T02:05:59.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90abfff700 1 -- 172.21.15.57:0/888031241 learned_addr learned my addr 172.21.15.57:0/888031241 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b305e700 1 -- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90b40d58e0 msgr2=0x7f90b40d5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b305e700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90b40d58e0 0x7f90b40d5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b305e700 1 -- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b41b10a0 msgr2=0x7f90b41b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b305e700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b41b10a0 0x7f90b41b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b305e700 1 -- 172.21.15.57:0/888031241 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b40c4a80 con 0x7f90b41b1b20 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b285d700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90b40d58e0 0x7f90b40d5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90abfff700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b41b10a0 0x7f90b41b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b305e700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b41b1b20 0x7f90b41b8560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f90b40c52c0 tx=0x7f90ac00c960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b0859700 1 -- 172.21.15.57:0/888031241 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90ac005da0 con 0x7f90b41b1b20 2024-04-25T02:05:59.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b0859700 1 -- 172.21.15.57:0/888031241 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac0048b0 con 0x7f90b41b1b20 2024-04-25T02:05:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b40c3eb0 con 0x7f90b41b1b20 2024-04-25T02:05:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b0859700 1 -- 172.21.15.57:0/888031241 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90ac004c80 con 0x7f90b41b1b20 2024-04-25T02:05:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.586 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b41b1f70 con 0x7f90b41b1b20 2024-04-25T02:05:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.587 7f90b0859700 1 -- 172.21.15.57:0/888031241 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f90ac007110 con 0x7f90b41b1b20 2024-04-25T02:05:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.587 7f90b0859700 1 -- 172.21.15.57:0/888031241 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f90ac012160 con 0x7f90b41b1b20 2024-04-25T02:05:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.588 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b40f08e0 con 0x7f90b41b1b20 2024-04-25T02:05:59.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.591 7f90b0859700 1 -- 172.21.15.57:0/888031241 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f90ac0059a0 con 0x7f90b41b1b20 2024-04-25T02:05:59.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.702 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90b41ab860 con 0x7f90b41b1b20 2024-04-25T02:05:59.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.702 7f90b0859700 1 -- 172.21.15.57:0/888031241 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90b41145f0 con 0x7f90b41b1b20 2024-04-25T02:05:59.708 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:05:59.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.703 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 >> v1:172.21.15.57:6816/43033 conn(0x7f90980145b0 legacy=0x7f9098016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.703 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b41b1b20 msgr2=0x7f90b41b8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.703 7f90b9bbe700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b41b1b20 0x7f90b41b8560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f90b40c52c0 tx=0x7f90ac00c960).stop 2024-04-25T02:05:59.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.704 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 shutdown_connections 2024-04-25T02:05:59.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.704 7f90b9bbe700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90b41b1b20 0x7f90b41b8560 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.704 7f90b9bbe700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90b40d58e0 0x7f90b40d5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.704 7f90b9bbe700 1 --2- 172.21.15.57:0/888031241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90b41b10a0 0x7f90b41b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.704 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 >> 172.21.15.57:0/888031241 conn(0x7f90b40c59c0 msgr2=0x7f90b40c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:59.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.704 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 shutdown_connections 2024-04-25T02:05:59.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.704 7f90b9bbe700 1 -- 172.21.15.57:0/888031241 wait complete. 2024-04-25T02:05:59.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23fc1bd700 1 Processor -- start 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23fc1bd700 1 -- start start 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23fc1bd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23f40f5920 0x7f23f410c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23fc1bd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f410c970 0x7f23f40f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23fc1bd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f40f26c0 con 0x7f23f410cdc0 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23fc1bd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f40fa290 con 0x7f23f40f5920 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23fc1bd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f40f95c0 con 0x7f23f410c970 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23f8fb8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23f40f5920 0x7f23f410c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23f3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f410c970 0x7f23f40f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23f8fb8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23f40f5920 0x7f23f410c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60878/0 (socket says 172.21.15.57:60878) 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23f8fb8700 1 -- 172.21.15.57:0/4162040505 learned_addr learned my addr 172.21.15.57:0/4162040505 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23f3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f410c970 0x7f23f40f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47782/0 (socket says 172.21.15.57:47782) 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.849 7f23f97b9700 1 --1- 172.21.15.57:0/4162040505 >> v1:172.21.15.57:6789/0 conn(0x7f23f410cdc0 0x7f23f40f1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46850/0 (socket says 172.21.15.57:46850) 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f8fb8700 1 -- 172.21.15.57:0/4162040505 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f410c970 msgr2=0x7f23f40f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f8fb8700 1 --2- 172.21.15.57:0/4162040505 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f410c970 0x7f23f40f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f8fb8700 1 -- 172.21.15.57:0/4162040505 >> v1:172.21.15.57:6789/0 conn(0x7f23f410cdc0 legacy=0x7f23f40f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f8fb8700 1 -- 172.21.15.57:0/4162040505 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f41aa5e0 con 0x7f23f40f5920 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f37fe700 1 -- 172.21.15.57:0/4162040505 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354736828 0 0) 0x7f23ec001490 con 0x7f23f410cdc0 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f3fff700 1 --2- 172.21.15.57:0/4162040505 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f410c970 0x7f23f40f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f8fb8700 1 --2- 172.21.15.57:0/4162040505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40f5920 0x7f23f410c340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f23f40f9770 tx=0x7f23e800de30).ready entity=mon.0 client_cookie=bec9276d15553f0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f37fe700 1 -- 172.21.15.57:0/4162040505 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23f41aa5e0 con 0x7f23f40f5920 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f37fe700 1 -- 172.21.15.57:0/4162040505 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e800f7b0 con 0x7f23f40f5920 2024-04-25T02:05:59.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23f37fe700 1 -- 172.21.15.57:0/4162040505 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23e8013070 con 0x7f23f40f5920 2024-04-25T02:05:59.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23fc1bd700 1 -- 172.21.15.57:0/4162040505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40f5920 msgr2=0x7f23f410c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.850 7f23fc1bd700 1 --2- 172.21.15.57:0/4162040505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40f5920 0x7f23f410c340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f23f40f9770 tx=0x7f23e800de30).stop 2024-04-25T02:05:59.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.851 7f23fc1bd700 1 -- 172.21.15.57:0/4162040505 shutdown_connections 2024-04-25T02:05:59.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.851 7f23fc1bd700 1 --2- 172.21.15.57:0/4162040505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40f5920 0x7f23f410c340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.851 7f23fc1bd700 1 --2- 172.21.15.57:0/4162040505 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f410c970 0x7f23f40f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.851 7f23fc1bd700 1 -- 172.21.15.57:0/4162040505 >> 172.21.15.57:0/4162040505 conn(0x7f23f4113a70 msgr2=0x7f23f40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:59.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.851 7f23fc1bd700 1 -- 172.21.15.57:0/4162040505 shutdown_connections 2024-04-25T02:05:59.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.851 7f23fc1bd700 1 -- 172.21.15.57:0/4162040505 wait complete. 2024-04-25T02:05:59.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23fc1bd700 1 Processor -- start 2024-04-25T02:05:59.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23fc1bd700 1 -- start start 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23fc1bd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f23f40d4e10 0x7f23f40d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23fc1bd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40d1f10 0x7f23f41b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23fc1bd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f41b0950 0x7f23f41b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23fc1bd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f40dc4b0 con 0x7f23f40d1f10 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23fc1bd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f40d5260 con 0x7f23f41b0950 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23fc1bd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23f41b13d0 con 0x7f23f40d4e10 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23f3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40d1f10 0x7f23f41b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23f97b9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f41b0950 0x7f23f41b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23f3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40d1f10 0x7f23f41b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60888/0 (socket says 172.21.15.57:60888) 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23f8fb8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f23f40d4e10 0x7f23f40d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.875 7f23f3fff700 1 -- 172.21.15.57:0/1079084414 learned_addr learned my addr 172.21.15.57:0/1079084414 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f3fff700 1 -- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f23f40d4e10 msgr2=0x7f23f40d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f3fff700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f23f40d4e10 0x7f23f40d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f3fff700 1 -- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f41b0950 msgr2=0x7f23f41b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f3fff700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f41b0950 0x7f23f41b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f3fff700 1 -- 172.21.15.57:0/1079084414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f41b7800 con 0x7f23f40d1f10 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f8fb8700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f23f40d4e10 0x7f23f40d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f97b9700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f41b0950 0x7f23f41b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f3fff700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40d1f10 0x7f23f41b0320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f23f40d5410 tx=0x7f23e000bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f1ffb700 1 -- 172.21.15.57:0/1079084414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23f41b7800 con 0x7f23f40d1f10 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f41b7a00 con 0x7f23f40d1f10 2024-04-25T02:05:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f1ffb700 1 -- 172.21.15.57:0/1079084414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e000c9a0 con 0x7f23f40d1f10 2024-04-25T02:05:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f1ffb700 1 -- 172.21.15.57:0/1079084414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f23e000f040 con 0x7f23f40d1f10 2024-04-25T02:05:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f41b7de0 con 0x7f23f40d1f10 2024-04-25T02:05:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f1ffb700 1 -- 172.21.15.57:0/1079084414 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f23e0011070 con 0x7f23f40d1f10 2024-04-25T02:05:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.876 7f23f1ffb700 1 -- 172.21.15.57:0/1079084414 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f23e0010040 con 0x7f23f40d1f10 2024-04-25T02:05:59.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.877 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f40c2970 con 0x7f23f40d1f10 2024-04-25T02:05:59.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.880 7f23f1ffb700 1 -- 172.21.15.57:0/1079084414 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f23e000c5a0 con 0x7f23f40d1f10 2024-04-25T02:05:59.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.991 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23f40f08e0 con 0x7f23f40d1f10 2024-04-25T02:05:59.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.991 7f23f1ffb700 1 -- 172.21.15.57:0/1079084414 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23e0000c30 con 0x7f23f40d1f10 2024-04-25T02:05:59.997 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:05:59.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 >> v1:172.21.15.57:6816/43033 conn(0x7f23dc0145b0 legacy=0x7f23dc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40d1f10 msgr2=0x7f23f41b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40d1f10 0x7f23f41b0320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f23f40d5410 tx=0x7f23e000bf70).stop 2024-04-25T02:05:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 shutdown_connections 2024-04-25T02:05:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23f41b0950 0x7f23f41b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f23f40d4e10 0x7f23f40d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 --2- 172.21.15.57:0/1079084414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23f40d1f10 0x7f23f41b0320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:05:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 >> 172.21.15.57:0/1079084414 conn(0x7f23f40c53b0 msgr2=0x7f23f40debf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 shutdown_connections 2024-04-25T02:05:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:05:59.992 7f23fc1bd700 1 -- 172.21.15.57:0/1079084414 wait complete. 2024-04-25T02:06:00.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:00.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.136 7f84c4491700 1 Processor -- start 2024-04-25T02:06:00.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.136 7f84c4491700 1 -- start start 2024-04-25T02:06:00.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c4491700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84bc0f5a10 0x7f84bc10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c4491700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc10b740 0x7f84bc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c4491700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc10bb90 0x7f84bc1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c4491700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0fa590 con 0x7f84bc0f5a10 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c4491700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc1a08a0 con 0x7f84bc10bb90 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c4491700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc1a0ad0 con 0x7f84bc10b740 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c128c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84bc0f5a10 0x7f84bc10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c0a8b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc10b740 0x7f84bc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c128c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84bc0f5a10 0x7f84bc10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60894/0 (socket says 172.21.15.57:60894) 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c0a8b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc10b740 0x7f84bc19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40100/0 (socket says 172.21.15.57:40100) 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c128c700 1 -- 172.21.15.57:0/3116149067 learned_addr learned my addr 172.21.15.57:0/3116149067 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c1a8d700 1 --2- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc10bb90 0x7f84bc1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c1a8d700 1 -- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc10b740 msgr2=0x7f84bc19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c1a8d700 1 --2- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc10b740 0x7f84bc19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c1a8d700 1 -- 172.21.15.57:0/3116149067 >> v2:172.21.15.57:3300/0 conn(0x7f84bc0f5a10 msgr2=0x7f84bc10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:00.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c1a8d700 1 --2- 172.21.15.57:0/3116149067 >> v2:172.21.15.57:3300/0 conn(0x7f84bc0f5a10 0x7f84bc10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c1a8d700 1 -- 172.21.15.57:0/3116149067 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0f1890 con 0x7f84bc10bb90 2024-04-25T02:06:00.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c128c700 1 --2- 172.21.15.57:0/3116149067 >> v2:172.21.15.57:3300/0 conn(0x7f84bc0f5a10 0x7f84bc10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.137 7f84c0a8b700 1 --2- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc10b740 0x7f84bc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c1a8d700 1 --2- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc10bb90 0x7f84bc1a0270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f84bc0f47c0 tx=0x7f84b4009d70).ready entity=mon.1 client_cookie=852cc55be7f13318 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:00.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84abfff700 1 -- 172.21.15.57:0/3116149067 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84bc0f1890 con 0x7f84bc10bb90 2024-04-25T02:06:00.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84abfff700 1 -- 172.21.15.57:0/3116149067 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b400b780 con 0x7f84bc10bb90 2024-04-25T02:06:00.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84abfff700 1 -- 172.21.15.57:0/3116149067 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84b400b960 con 0x7f84bc10bb90 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 -- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc10bb90 msgr2=0x7f84bc1a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 --2- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc10bb90 0x7f84bc1a0270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f84bc0f47c0 tx=0x7f84b4009d70).stop 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 -- 172.21.15.57:0/3116149067 shutdown_connections 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 --2- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc10bb90 0x7f84bc1a0270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 --2- 172.21.15.57:0/3116149067 >> v2:172.21.15.57:3300/0 conn(0x7f84bc0f5a10 0x7f84bc10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 --2- 172.21.15.57:0/3116149067 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc10b740 0x7f84bc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 -- 172.21.15.57:0/3116149067 >> 172.21.15.57:0/3116149067 conn(0x7f84bc113a70 msgr2=0x7f84bc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 -- 172.21.15.57:0/3116149067 shutdown_connections 2024-04-25T02:06:00.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.138 7f84c4491700 1 -- 172.21.15.57:0/3116149067 wait complete. 2024-04-25T02:06:00.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.162 7f84c4491700 1 Processor -- start 2024-04-25T02:06:00.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.162 7f84c4491700 1 -- start start 2024-04-25T02:06:00.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c4491700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84bc0ca3b0 0x7f84bc0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c4491700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc0cae30 0x7f84bc1b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c4491700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc1b27d0 0x7f84bc1b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c4491700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0cfc50 con 0x7f84bc0ca3b0 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c4491700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0bd470 con 0x7f84bc0cae30 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c4491700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0cd340 con 0x7f84bc1b27d0 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c128c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84bc0ca3b0 0x7f84bc0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c1a8d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc1b27d0 0x7f84bc1b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c0a8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc0cae30 0x7f84bc1b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c1a8d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc1b27d0 0x7f84bc1b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40110/0 (socket says 172.21.15.57:40110) 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c128c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84bc0ca3b0 0x7f84bc0ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60896/0 (socket says 172.21.15.57:60896) 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c0a8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc0cae30 0x7f84bc1b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47808/0 (socket says 172.21.15.57:47808) 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c1a8d700 1 -- 172.21.15.57:0/525393161 learned_addr learned my addr 172.21.15.57:0/525393161 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c0a8b700 1 -- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc1b27d0 msgr2=0x7f84bc1b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c0a8b700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc1b27d0 0x7f84bc1b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c0a8b700 1 -- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84bc0ca3b0 msgr2=0x7f84bc0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c0a8b700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84bc0ca3b0 0x7f84bc0ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c0a8b700 1 -- 172.21.15.57:0/525393161 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0bcc60 con 0x7f84bc0cae30 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c1a8d700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc1b27d0 0x7f84bc1b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c128c700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84bc0ca3b0 0x7f84bc0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.163 7f84c0a8b700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc0cae30 0x7f84bc1b21a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f84ac00c000 tx=0x7f84ac00eca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.164 7f84aa7fc700 1 -- 172.21.15.57:0/525393161 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84bc0bcc60 con 0x7f84bc0cae30 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.164 7f84aa7fc700 1 -- 172.21.15.57:0/525393161 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac00c790 con 0x7f84bc0cae30 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.164 7f84aa7fc700 1 -- 172.21.15.57:0/525393161 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f84ac00f040 con 0x7f84bc0cae30 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.164 7f84c4491700 1 -- 172.21.15.57:0/525393161 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0bd050 con 0x7f84bc0cae30 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.164 7f84c4491700 1 -- 172.21.15.57:0/525393161 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc1b9b80 con 0x7f84bc0cae30 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.164 7f84aa7fc700 1 -- 172.21.15.57:0/525393161 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f84ac011070 con 0x7f84bc0cae30 2024-04-25T02:06:00.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.164 7f84aa7fc700 1 -- 172.21.15.57:0/525393161 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f84ac010040 con 0x7f84bc0cae30 2024-04-25T02:06:00.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.165 7f84c4491700 1 -- 172.21.15.57:0/525393161 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc0f08e0 con 0x7f84bc0cae30 2024-04-25T02:06:00.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.168 7f84aa7fc700 1 -- 172.21.15.57:0/525393161 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f84ac00cb60 con 0x7f84bc0cae30 2024-04-25T02:06:00.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.310 7f84c4491700 1 -- 172.21.15.57:0/525393161 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84bc1ac8a0 con 0x7f84bc0cae30 2024-04-25T02:06:00.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.311 7f84aa7fc700 1 -- 172.21.15.57:0/525393161 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1702 (secure 0 0 0) 0x7f84ac000c30 con 0x7f84bc0cae30 2024-04-25T02:06:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:00.317 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:05:47.333033","modified":"2024-04-25 02:05:49.360768","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:06:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 -- 172.21.15.57:0/525393161 >> v1:172.21.15.57:6816/43033 conn(0x7f849c0145b0 legacy=0x7f849c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 -- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc0cae30 msgr2=0x7f84bc1b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc0cae30 0x7f84bc1b21a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f84ac00c000 tx=0x7f84ac00eca0).stop 2024-04-25T02:06:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 -- 172.21.15.57:0/525393161 shutdown_connections 2024-04-25T02:06:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84bc1b27d0 0x7f84bc1b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84bc0ca3b0 0x7f84bc0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 --2- 172.21.15.57:0/525393161 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84bc0cae30 0x7f84bc1b21a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 -- 172.21.15.57:0/525393161 >> 172.21.15.57:0/525393161 conn(0x7f84bc0be6d0 msgr2=0x7f84bc0d9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 -- 172.21.15.57:0/525393161 shutdown_connections 2024-04-25T02:06:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.312 7f84c4491700 1 -- 172.21.15.57:0/525393161 wait complete. 2024-04-25T02:06:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T02:06:00.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:00.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.455 7f7ef77cd700 1 Processor -- start 2024-04-25T02:06:00.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.455 7f7ef77cd700 1 -- start start 2024-04-25T02:06:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7ef77cd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef010ec60 0x7f7ef01a8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7ef77cd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01a8dc0 0x7f7ef01ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7ef77cd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef010f0b0 con 0x7f7ef0106530 2024-04-25T02:06:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7ef77cd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00fb670 con 0x7f7ef010ec60 2024-04-25T02:06:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7ef77cd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0106980 con 0x7f7ef01a8dc0 2024-04-25T02:06:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eef7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef010ec60 0x7f7ef01a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7ef4dc9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01a8dc0 0x7f7ef01ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eeffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7ef0106530 0x7f7ef010e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46852/0 (socket says 172.21.15.57:46852) 2024-04-25T02:06:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eeffff700 1 -- 172.21.15.57:0/934949025 learned_addr learned my addr 172.21.15.57:0/934949025 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eef7fe700 1 -- 172.21.15.57:0/934949025 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01a8dc0 msgr2=0x7f7ef01ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eef7fe700 1 --2- 172.21.15.57:0/934949025 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01a8dc0 0x7f7ef01ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eeeffd700 1 -- 172.21.15.57:0/934949025 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224295745 0 0) 0x7f7ee0001110 con 0x7f7ef0106530 2024-04-25T02:06:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eef7fe700 1 -- 172.21.15.57:0/934949025 >> v1:172.21.15.57:6789/0 conn(0x7f7ef0106530 legacy=0x7f7ef010e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eef7fe700 1 -- 172.21.15.57:0/934949025 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef01ac860 con 0x7f7ef010ec60 2024-04-25T02:06:00.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7ef4dc9700 1 --2- 172.21.15.57:0/934949025 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01a8dc0 0x7f7ef01ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eef7fe700 1 --2- 172.21.15.57:0/934949025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef010ec60 0x7f7ef01a8790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7ef00fb820 tx=0x7f7ee400ba50).ready entity=mon.1 client_cookie=c02f1fcfaaeb81b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:00.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.456 7f7eeeffd700 1 -- 172.21.15.57:0/934949025 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ef01ac860 con 0x7f7ef010ec60 2024-04-25T02:06:00.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7eeeffd700 1 -- 172.21.15.57:0/934949025 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee400d570 con 0x7f7ef010ec60 2024-04-25T02:06:00.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7eeeffd700 1 -- 172.21.15.57:0/934949025 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ee400d940 con 0x7f7ef010ec60 2024-04-25T02:06:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7ef77cd700 1 -- 172.21.15.57:0/934949025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef010ec60 msgr2=0x7f7ef01a8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7ef77cd700 1 --2- 172.21.15.57:0/934949025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef010ec60 0x7f7ef01a8790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7ef00fb820 tx=0x7f7ee400ba50).stop 2024-04-25T02:06:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7ef77cd700 1 -- 172.21.15.57:0/934949025 shutdown_connections 2024-04-25T02:06:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7ef77cd700 1 --2- 172.21.15.57:0/934949025 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01a8dc0 0x7f7ef01ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7ef77cd700 1 --2- 172.21.15.57:0/934949025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef010ec60 0x7f7ef01a8790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7ef77cd700 1 -- 172.21.15.57:0/934949025 >> 172.21.15.57:0/934949025 conn(0x7f7ef0114940 msgr2=0x7f7ef0114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7ef77cd700 1 -- 172.21.15.57:0/934949025 shutdown_connections 2024-04-25T02:06:00.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.457 7f7ef77cd700 1 -- 172.21.15.57:0/934949025 wait complete. 2024-04-25T02:06:00.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.481 7f7ef77cd700 1 Processor -- start 2024-04-25T02:06:00.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.481 7f7ef77cd700 1 -- start start 2024-04-25T02:06:00.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7ef77cd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef00d5490 0x7f7ef00d58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7ef77cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ef00d5f10 0x7f7ef01b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7ef77cd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01b4c10 0x7f7ef01b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7ef77cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00dc920 con 0x7f7ef00d5f10 2024-04-25T02:06:00.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7ef77cd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00c49f0 con 0x7f7ef00d5490 2024-04-25T02:06:00.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7ef77cd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00dcc70 con 0x7f7ef01b4c10 2024-04-25T02:06:00.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eeffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef00d5490 0x7f7ef00d58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eef7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ef00d5f10 0x7f7ef01b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eeffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef00d5490 0x7f7ef00d58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47836/0 (socket says 172.21.15.57:47836) 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7ef4dc9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01b4c10 0x7f7ef01b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eeffff700 1 -- 172.21.15.57:0/4255925882 learned_addr learned my addr 172.21.15.57:0/4255925882 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eeffff700 1 -- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01b4c10 msgr2=0x7f7ef01b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eeffff700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01b4c10 0x7f7ef01b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eeffff700 1 -- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ef00d5f10 msgr2=0x7f7ef01b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eeffff700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ef00d5f10 0x7f7ef01b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eeffff700 1 -- 172.21.15.57:0/4255925882 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef00cec70 con 0x7f7ef00d5490 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7eef7fe700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ef00d5f10 0x7f7ef01b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.482 7f7ef4dc9700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01b4c10 0x7f7ef01b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.483 7f7eeffff700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef00d5490 0x7f7ef00d58e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7ef00c5b20 tx=0x7f7ee000c890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.483 7f7eed7fa700 1 -- 172.21.15.57:0/4255925882 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ef00cec70 con 0x7f7ef00d5490 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.483 7f7eed7fa700 1 -- 172.21.15.57:0/4255925882 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee00072e0 con 0x7f7ef00d5490 2024-04-25T02:06:00.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.483 7f7eed7fa700 1 -- 172.21.15.57:0/4255925882 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ee0005810 con 0x7f7ef00d5490 2024-04-25T02:06:00.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.483 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef00dd420 con 0x7f7ef00d5490 2024-04-25T02:06:00.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.483 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef01bbd50 con 0x7f7ef00d5490 2024-04-25T02:06:00.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.483 7f7eed7fa700 1 -- 172.21.15.57:0/4255925882 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7ee0005a10 con 0x7f7ef00d5490 2024-04-25T02:06:00.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.483 7f7eed7fa700 1 -- 172.21.15.57:0/4255925882 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7ee00149e0 con 0x7f7ef00d5490 2024-04-25T02:06:00.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.484 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef00f08e0 con 0x7f7ef00d5490 2024-04-25T02:06:00.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.487 7f7eed7fa700 1 -- 172.21.15.57:0/4255925882 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7ee00070d0 con 0x7f7ef00d5490 2024-04-25T02:06:00.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.597 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ef00e2430 con 0x7f7ef00d5490 2024-04-25T02:06:00.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.597 7f7eed7fa700 1 -- 172.21.15.57:0/4255925882 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7f7ee0000c30 con 0x7f7ef00d5490 2024-04-25T02:06:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:48.339447","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 >> v1:172.21.15.57:6816/43033 conn(0x7f7ed00145b0 legacy=0x7f7ed0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef00d5490 msgr2=0x7f7ef00d58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef00d5490 0x7f7ef00d58e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7ef00c5b20 tx=0x7f7ee000c890).stop 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 shutdown_connections 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ef01b4c10 0x7f7ef01b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ef00d5490 0x7f7ef00d58e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 --2- 172.21.15.57:0/4255925882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ef00d5f10 0x7f7ef01b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 >> 172.21.15.57:0/4255925882 conn(0x7f7ef00cf990 msgr2=0x7f7ef01a85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 shutdown_connections 2024-04-25T02:06:00.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.599 7f7ef77cd700 1 -- 172.21.15.57:0/4255925882 wait complete. 2024-04-25T02:06:00.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:00.616 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fcb11d700 1 Processor -- start 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fcb11d700 1 -- start start 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fcb11d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40f5920 0x7f2fc410c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fcb11d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fc410cdc0 0x7f2fc40f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fcb11d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40f26c0 con 0x7f2fc410c970 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fcb11d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc40fa290 con 0x7f2fc410cdc0 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fcb11d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40f95c0 con 0x7f2fc40f5920 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fc37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40f5920 0x7f2fc410c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fc3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fc410cdc0 0x7f2fc40f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fc3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fc410cdc0 0x7f2fc40f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60918/0 (socket says 172.21.15.57:60918) 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fc37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40f5920 0x7f2fc410c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40152/0 (socket says 172.21.15.57:40152) 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fc3fff700 1 -- 172.21.15.57:0/4133491757 learned_addr learned my addr 172.21.15.57:0/4133491757 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.745 7f2fc2ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2fc410c970 0x7f2fc40f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46862/0 (socket says 172.21.15.57:46862) 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc37fe700 1 -- 172.21.15.57:0/4133491757 >> v2:172.21.15.57:3300/0 conn(0x7f2fc410cdc0 msgr2=0x7f2fc40f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc37fe700 1 --2- 172.21.15.57:0/4133491757 >> v2:172.21.15.57:3300/0 conn(0x7f2fc410cdc0 0x7f2fc40f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc37fe700 1 -- 172.21.15.57:0/4133491757 >> v1:172.21.15.57:6789/0 conn(0x7f2fc410c970 legacy=0x7f2fc40f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc37fe700 1 -- 172.21.15.57:0/4133491757 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc41aa5e0 con 0x7f2fc40f5920 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc27fc700 1 -- 172.21.15.57:0/4133491757 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534704803 0 0) 0x7f2fb4001110 con 0x7f2fc410c970 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc3fff700 1 --2- 172.21.15.57:0/4133491757 >> v2:172.21.15.57:3300/0 conn(0x7f2fc410cdc0 0x7f2fc40f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc37fe700 1 --2- 172.21.15.57:0/4133491757 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40f5920 0x7f2fc410c340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2fac002f70 tx=0x7f2fac00b970).ready entity=mon.2 client_cookie=50081796466a2db2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc27fc700 1 -- 172.21.15.57:0/4133491757 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2fc41aa5e0 con 0x7f2fc40f5920 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc27fc700 1 -- 172.21.15.57:0/4133491757 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac00d5c0 con 0x7f2fc40f5920 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fc27fc700 1 -- 172.21.15.57:0/4133491757 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2fac00d990 con 0x7f2fc40f5920 2024-04-25T02:06:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fcb11d700 1 -- 172.21.15.57:0/4133491757 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40f5920 msgr2=0x7f2fc410c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.746 7f2fcb11d700 1 --2- 172.21.15.57:0/4133491757 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40f5920 0x7f2fc410c340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2fac002f70 tx=0x7f2fac00b970).stop 2024-04-25T02:06:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.747 7f2fcb11d700 1 -- 172.21.15.57:0/4133491757 shutdown_connections 2024-04-25T02:06:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.747 7f2fcb11d700 1 --2- 172.21.15.57:0/4133491757 >> v2:172.21.15.57:3300/0 conn(0x7f2fc410cdc0 0x7f2fc40f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.747 7f2fcb11d700 1 --2- 172.21.15.57:0/4133491757 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40f5920 0x7f2fc410c340 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.747 7f2fcb11d700 1 -- 172.21.15.57:0/4133491757 >> 172.21.15.57:0/4133491757 conn(0x7f2fc4113a70 msgr2=0x7f2fc40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.747 7f2fcb11d700 1 -- 172.21.15.57:0/4133491757 shutdown_connections 2024-04-25T02:06:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.747 7f2fcb11d700 1 -- 172.21.15.57:0/4133491757 wait complete. 2024-04-25T02:06:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fcb11d700 1 Processor -- start 2024-04-25T02:06:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fcb11d700 1 -- start start 2024-04-25T02:06:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fcb11d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40d54c0 0x7f2fc40d5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fcb11d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fc40d5f40 0x7f2fc41b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fcb11d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fc41b2980 0x7f2fc41b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fcb11d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40de400 con 0x7f2fc41b2980 2024-04-25T02:06:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fcb11d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41b3400 con 0x7f2fc40d5f40 2024-04-25T02:06:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fcb11d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40dc8e0 con 0x7f2fc40d54c0 2024-04-25T02:06:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fc37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40d54c0 0x7f2fc40d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fc2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fc40d5f40 0x7f2fc41b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fc3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fc41b2980 0x7f2fc41b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fc2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fc40d5f40 0x7f2fc41b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47838/0 (socket says 172.21.15.57:47838) 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fc37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40d54c0 0x7f2fc40d5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40156/0 (socket says 172.21.15.57:40156) 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fc3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fc41b2980 0x7f2fc41b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60926/0 (socket says 172.21.15.57:60926) 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.772 7f2fc2ffd700 1 -- 172.21.15.57:0/3327014253 learned_addr learned my addr 172.21.15.57:0/3327014253 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.773 7f2fc37fe700 1 -- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fc40d5f40 msgr2=0x7f2fc41b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.773 7f2fc37fe700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fc40d5f40 0x7f2fc41b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.773 7f2fc37fe700 1 -- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fc41b2980 msgr2=0x7f2fc41b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.773 7f2fc37fe700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fc41b2980 0x7f2fc41b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.773 7f2fc37fe700 1 -- 172.21.15.57:0/3327014253 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40ceaf0 con 0x7f2fc40d54c0 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.773 7f2fc3fff700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fc41b2980 0x7f2fc41b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.773 7f2fc2ffd700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fc40d5f40 0x7f2fc41b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.773 7f2fc37fe700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40d54c0 0x7f2fc40d5910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2fc41a7540 tx=0x7f2fac0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.781 7f2fc0ff9700 1 -- 172.21.15.57:0/3327014253 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2fc40ceaf0 con 0x7f2fc40d54c0 2024-04-25T02:06:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.781 7f2fc0ff9700 1 -- 172.21.15.57:0/3327014253 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0117e0 con 0x7f2fc40d54c0 2024-04-25T02:06:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.781 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc41b9a40 con 0x7f2fc40d54c0 2024-04-25T02:06:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.781 7f2fc0ff9700 1 -- 172.21.15.57:0/3327014253 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2fac017040 con 0x7f2fc40d54c0 2024-04-25T02:06:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.781 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc41b9e20 con 0x7f2fc40d54c0 2024-04-25T02:06:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.781 7f2fc0ff9700 1 -- 172.21.15.57:0/3327014253 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f2fac011bb0 con 0x7f2fc40d54c0 2024-04-25T02:06:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.781 7f2fc0ff9700 1 -- 172.21.15.57:0/3327014253 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f2fac018070 con 0x7f2fc40d54c0 2024-04-25T02:06:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.782 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc40f08e0 con 0x7f2fc40d54c0 2024-04-25T02:06:00.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.785 7f2fc0ff9700 1 -- 172.21.15.57:0/3327014253 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f2fac0115d0 con 0x7f2fc40d54c0 2024-04-25T02:06:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.895 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2fc41aca90 con 0x7f2fc40d54c0 2024-04-25T02:06:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.896 7f2fc0ff9700 1 -- 172.21.15.57:0/3327014253 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2fac00d3b0 con 0x7f2fc40d54c0 2024-04-25T02:06:00.901 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:00.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 >> v1:172.21.15.57:6816/43033 conn(0x7f2fa80145b0 legacy=0x7f2fa8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40d54c0 msgr2=0x7f2fc40d5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40d54c0 0x7f2fc40d5910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2fc41a7540 tx=0x7f2fac0068c0).stop 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 shutdown_connections 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fc41b2980 0x7f2fc41b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2fc40d54c0 0x7f2fc40d5910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 --2- 172.21.15.57:0/3327014253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fc40d5f40 0x7f2fc41b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 >> 172.21.15.57:0/3327014253 conn(0x7f2fc40cf9c0 msgr2=0x7f2fc41a6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 shutdown_connections 2024-04-25T02:06:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:00.897 7f2fcb11d700 1 -- 172.21.15.57:0/3327014253 wait complete. 2024-04-25T02:06:00.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.041 7f13c3cbf700 1 Processor -- start 2024-04-25T02:06:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.041 7f13c3cbf700 1 -- start start 2024-04-25T02:06:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c3cbf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0f58a0 0x7f13bc10c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c3cbf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc10c8f0 0x7f13bc0f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c3cbf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc0f2640 con 0x7f13bc10cd40 2024-04-25T02:06:01.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c3cbf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0fa210 con 0x7f13bc10c8f0 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c3cbf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0f9540 con 0x7f13bc0f58a0 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13bbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc10c8f0 0x7f13bc0f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c12bb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f13bc10cd40 0x7f13bc0f1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46866/0 (socket says 172.21.15.57:46866) 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c12bb700 1 -- 172.21.15.57:0/432487848 learned_addr learned my addr 172.21.15.57:0/432487848 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c0aba700 1 --2- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0f58a0 0x7f13bc10c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13bb7fe700 1 -- 172.21.15.57:0/432487848 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119634083 0 0) 0x7f13b4001490 con 0x7f13bc10cd40 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13bbfff700 1 -- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0f58a0 msgr2=0x7f13bc10c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13bbfff700 1 --2- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0f58a0 0x7f13bc10c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13bbfff700 1 -- 172.21.15.57:0/432487848 >> v1:172.21.15.57:6789/0 conn(0x7f13bc10cd40 legacy=0x7f13bc0f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13bbfff700 1 -- 172.21.15.57:0/432487848 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc1aa560 con 0x7f13bc10c8f0 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13c0aba700 1 --2- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0f58a0 0x7f13bc10c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.042 7f13bbfff700 1 --2- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc10c8f0 0x7f13bc0f1810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f13a4002f70 tx=0x7f13a400ba20).ready entity=mon.1 client_cookie=a9711a04db04cf71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13bb7fe700 1 -- 172.21.15.57:0/432487848 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13bc1aa560 con 0x7f13bc10c8f0 2024-04-25T02:06:01.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13bb7fe700 1 -- 172.21.15.57:0/432487848 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a400d570 con 0x7f13bc10c8f0 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13bb7fe700 1 -- 172.21.15.57:0/432487848 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13a400d940 con 0x7f13bc10c8f0 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13c3cbf700 1 -- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc10c8f0 msgr2=0x7f13bc0f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13c3cbf700 1 --2- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc10c8f0 0x7f13bc0f1810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f13a4002f70 tx=0x7f13a400ba20).stop 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13c3cbf700 1 -- 172.21.15.57:0/432487848 shutdown_connections 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13c3cbf700 1 --2- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0f58a0 0x7f13bc10c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13c3cbf700 1 --2- 172.21.15.57:0/432487848 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc10c8f0 0x7f13bc0f1810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13c3cbf700 1 -- 172.21.15.57:0/432487848 >> 172.21.15.57:0/432487848 conn(0x7f13bc1139f0 msgr2=0x7f13bc0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13c3cbf700 1 -- 172.21.15.57:0/432487848 shutdown_connections 2024-04-25T02:06:01.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.043 7f13c3cbf700 1 -- 172.21.15.57:0/432487848 wait complete. 2024-04-25T02:06:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.067 7f13c3cbf700 1 Processor -- start 2024-04-25T02:06:01.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.067 7f13c3cbf700 1 -- start start 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13c3cbf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0d7fa0 0x7f13bc0d6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13c3cbf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc0d6780 0x7f13bc1b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13c3cbf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc0d6bd0 0x7f13bc1b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13c3cbf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0dde70 con 0x7f13bc0d6780 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13c3cbf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0d79a0 con 0x7f13bc0d6bd0 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13c3cbf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc1b2cb0 con 0x7f13bc0d7fa0 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc0d6780 0x7f13bc1b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13c12bb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc0d6bd0 0x7f13bc1b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13c0aba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0d7fa0 0x7f13bc0d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc0d6780 0x7f13bc1b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60942/0 (socket says 172.21.15.57:60942) 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 -- 172.21.15.57:0/4102998094 learned_addr learned my addr 172.21.15.57:0/4102998094 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 -- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0d7fa0 msgr2=0x7f13bc0d6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 --2- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0d7fa0 0x7f13bc0d6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 -- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc0d6bd0 msgr2=0x7f13bc1b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 --2- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc0d6bd0 0x7f13bc1b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 -- 172.21.15.57:0/4102998094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc1b2ee0 con 0x7f13bc0d6780 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13bbfff700 1 --2- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc0d6780 0x7f13bc1b2050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f13a4002f70 tx=0x7f13a40068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13b9ffb700 1 -- 172.21.15.57:0/4102998094 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13bc1b2ee0 con 0x7f13bc0d6780 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13b9ffb700 1 -- 172.21.15.57:0/4102998094 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4011a00 con 0x7f13bc0d6780 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.068 7f13b9ffb700 1 -- 172.21.15.57:0/4102998094 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13a4011dd0 con 0x7f13bc0d6780 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.069 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc0f6310 con 0x7f13bc0d6780 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.069 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc0f67b0 con 0x7f13bc0d6780 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.069 7f13b9ffb700 1 -- 172.21.15.57:0/4102998094 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f13a4027460 con 0x7f13bc0d6780 2024-04-25T02:06:01.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.069 7f13b9ffb700 1 -- 172.21.15.57:0/4102998094 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f13a402b160 con 0x7f13bc0d6780 2024-04-25T02:06:01.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.070 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc0f0860 con 0x7f13bc0d6780 2024-04-25T02:06:01.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.073 7f13b9ffb700 1 -- 172.21.15.57:0/4102998094 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f13a40117f0 con 0x7f13bc0d6780 2024-04-25T02:06:01.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.183 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13bc1ac750 con 0x7f13bc0d6780 2024-04-25T02:06:01.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.184 7f13b9ffb700 1 -- 172.21.15.57:0/4102998094 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13a400d360 con 0x7f13bc0d6780 2024-04-25T02:06:01.189 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 >> v1:172.21.15.57:6816/43033 conn(0x7f13a00145b0 legacy=0x7f13a0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc0d6780 msgr2=0x7f13bc1b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 --2- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc0d6780 0x7f13bc1b2050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f13a4002f70 tx=0x7f13a40068c0).stop 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 shutdown_connections 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 --2- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13bc0d6bd0 0x7f13bc1b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 --2- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13bc0d7fa0 0x7f13bc0d6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 --2- 172.21.15.57:0/4102998094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc0d6780 0x7f13bc1b2050 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 >> 172.21.15.57:0/4102998094 conn(0x7f13bc0c8dd0 msgr2=0x7f13bc0c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 shutdown_connections 2024-04-25T02:06:01.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.185 7f13c3cbf700 1 -- 172.21.15.57:0/4102998094 wait complete. 2024-04-25T02:06:01.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:01.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94bc895700 1 Processor -- start 2024-04-25T02:06:01.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94bc895700 1 -- start start 2024-04-25T02:06:01.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94bc895700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80f5920 0x7f94b80f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94bc895700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80f1ec0 0x7f94b810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94bc895700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80f9230 con 0x7f94b80f2310 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94bc895700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b810f0e0 con 0x7f94b80f5920 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94bc895700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94b81ac680 con 0x7f94b80f1ec0 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94b4dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80f1ec0 0x7f94b810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94b55fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80f5920 0x7f94b80f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94b4dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80f1ec0 0x7f94b810e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40176/0 (socket says 172.21.15.57:40176) 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94b5dfc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f94b80f2310 0x7f94b810e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46882/0 (socket says 172.21.15.57:46882) 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.330 7f94b4dfa700 1 -- 172.21.15.57:0/1387724007 learned_addr learned my addr 172.21.15.57:0/1387724007 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94b55fb700 1 -- 172.21.15.57:0/1387724007 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80f1ec0 msgr2=0x7f94b810e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94b55fb700 1 --2- 172.21.15.57:0/1387724007 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80f1ec0 0x7f94b810e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94affff700 1 -- 172.21.15.57:0/1387724007 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232419102 0 0) 0x7f94b0001490 con 0x7f94b80f2310 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94b55fb700 1 -- 172.21.15.57:0/1387724007 >> v1:172.21.15.57:6789/0 conn(0x7f94b80f2310 legacy=0x7f94b810e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94b55fb700 1 -- 172.21.15.57:0/1387724007 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b81ac830 con 0x7f94b80f5920 2024-04-25T02:06:01.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94b4dfa700 1 --2- 172.21.15.57:0/1387724007 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80f1ec0 0x7f94b810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94b55fb700 1 --2- 172.21.15.57:0/1387724007 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80f5920 0x7f94b80f1890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f94a8002f70 tx=0x7f94a800ba20).ready entity=mon.1 client_cookie=e4505b6a9e05a89d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94affff700 1 -- 172.21.15.57:0/1387724007 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94b81ac830 con 0x7f94b80f5920 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94affff700 1 -- 172.21.15.57:0/1387724007 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a800d570 con 0x7f94b80f5920 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94affff700 1 -- 172.21.15.57:0/1387724007 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94a800d990 con 0x7f94b80f5920 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94bc895700 1 -- 172.21.15.57:0/1387724007 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80f5920 msgr2=0x7f94b80f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.331 7f94bc895700 1 --2- 172.21.15.57:0/1387724007 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80f5920 0x7f94b80f1890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f94a8002f70 tx=0x7f94a800ba20).stop 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.332 7f94bc895700 1 -- 172.21.15.57:0/1387724007 shutdown_connections 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.332 7f94bc895700 1 --2- 172.21.15.57:0/1387724007 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80f5920 0x7f94b80f1890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.332 7f94bc895700 1 --2- 172.21.15.57:0/1387724007 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80f1ec0 0x7f94b810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.332 7f94bc895700 1 -- 172.21.15.57:0/1387724007 >> 172.21.15.57:0/1387724007 conn(0x7f94b8113a70 msgr2=0x7f94b80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.332 7f94bc895700 1 -- 172.21.15.57:0/1387724007 shutdown_connections 2024-04-25T02:06:01.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.332 7f94bc895700 1 -- 172.21.15.57:0/1387724007 wait complete. 2024-04-25T02:06:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.355 7f94bc895700 1 Processor -- start 2024-04-25T02:06:01.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94bc895700 1 -- start start 2024-04-25T02:06:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94bc895700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80da450 0x7f94b80da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94bc895700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94b80daed0 0x7f94b80ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94bc895700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80ceef0 0x7f94b80cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94bc895700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80f0150 con 0x7f94b80daed0 2024-04-25T02:06:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94bc895700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80db4e0 con 0x7f94b80da450 2024-04-25T02:06:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94bc895700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80bcd70 con 0x7f94b80ceef0 2024-04-25T02:06:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b55fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80da450 0x7f94b80da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b5dfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80ceef0 0x7f94b80cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b4dfa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94b80daed0 0x7f94b80ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b55fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80da450 0x7f94b80da8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47886/0 (socket says 172.21.15.57:47886) 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b55fb700 1 -- 172.21.15.57:0/3969715950 learned_addr learned my addr 172.21.15.57:0/3969715950 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b5dfc700 1 -- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80da450 msgr2=0x7f94b80da8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b5dfc700 1 --2- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80da450 0x7f94b80da8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b5dfc700 1 -- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94b80daed0 msgr2=0x7f94b80ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b5dfc700 1 --2- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94b80daed0 0x7f94b80ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b5dfc700 1 -- 172.21.15.57:0/3969715950 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80bc0f0 con 0x7f94b80ceef0 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.356 7f94b55fb700 1 --2- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80da450 0x7f94b80da8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.357 7f94b5dfc700 1 --2- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80ceef0 0x7f94b80cf340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f94b80bc560 tx=0x7f94b000c910).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.357 7f94ae7fc700 1 -- 172.21.15.57:0/3969715950 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94b80bc0f0 con 0x7f94b80ceef0 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.357 7f94ae7fc700 1 -- 172.21.15.57:0/3969715950 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0005af0 con 0x7f94b80ceef0 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.357 7f94bc895700 1 -- 172.21.15.57:0/3969715950 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b81bc480 con 0x7f94b80ceef0 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.357 7f94ae7fc700 1 -- 172.21.15.57:0/3969715950 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94b00070d0 con 0x7f94b80ceef0 2024-04-25T02:06:01.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.357 7f94bc895700 1 -- 172.21.15.57:0/3969715950 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b81bc860 con 0x7f94b80ceef0 2024-04-25T02:06:01.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.357 7f94ae7fc700 1 -- 172.21.15.57:0/3969715950 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f94b00072d0 con 0x7f94b80ceef0 2024-04-25T02:06:01.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.357 7f94ae7fc700 1 -- 172.21.15.57:0/3969715950 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f94b0009d60 con 0x7f94b80ceef0 2024-04-25T02:06:01.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.358 7f94bc895700 1 -- 172.21.15.57:0/3969715950 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b80f08e0 con 0x7f94b80ceef0 2024-04-25T02:06:01.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.361 7f94ae7fc700 1 -- 172.21.15.57:0/3969715950 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f94b00058e0 con 0x7f94b80ceef0 2024-04-25T02:06:01.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.473 7f94bc895700 1 -- 172.21.15.57:0/3969715950 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94b80bf3b0 con 0x7f94b80ceef0 2024-04-25T02:06:01.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.473 7f94ae7fc700 1 -- 172.21.15.57:0/3969715950 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94b81145f0 con 0x7f94b80ceef0 2024-04-25T02:06:01.479 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:01.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.474 7f94bc895700 1 -- 172.21.15.57:0/3969715950 >> v1:172.21.15.57:6816/43033 conn(0x7f949c0145b0 legacy=0x7f949c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.474 7f94bc895700 1 -- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80ceef0 msgr2=0x7f94b80cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.474 7f94bc895700 1 --2- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80ceef0 0x7f94b80cf340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f94b80bc560 tx=0x7f94b000c910).stop 2024-04-25T02:06:01.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.474 7f94bc895700 1 -- 172.21.15.57:0/3969715950 shutdown_connections 2024-04-25T02:06:01.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.474 7f94bc895700 1 --2- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f94b80ceef0 0x7f94b80cf340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.474 7f94bc895700 1 --2- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94b80da450 0x7f94b80da8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.474 7f94bc895700 1 --2- 172.21.15.57:0/3969715950 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94b80daed0 0x7f94b80ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.474 7f94bc895700 1 -- 172.21.15.57:0/3969715950 >> 172.21.15.57:0/3969715950 conn(0x7f94b80bde10 msgr2=0x7f94b80dfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:01.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.475 7f94bc895700 1 -- 172.21.15.57:0/3969715950 shutdown_connections 2024-04-25T02:06:01.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.475 7f94bc895700 1 -- 172.21.15.57:0/3969715950 wait complete. 2024-04-25T02:06:01.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafd10f0700 1 Processor -- start 2024-04-25T02:06:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafd10f0700 1 -- start start 2024-04-25T02:06:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafd10f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fafcc10b910 0x7fafcc1a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafd10f0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1a59d0 0x7fafcc1a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafd10f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc10bd60 con 0x7fafcc0f5a10 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafd10f0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc0fa590 con 0x7fafcc10b910 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafd10f0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1a0c50 con 0x7fafcc1a59d0 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafc9dfc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fafcc0f5a10 0x7fafcc10b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46896/0 (socket says 172.21.15.57:46896) 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafc3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fafcc10b910 0x7fafcc1a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafc9dfc700 1 -- 172.21.15.57:0/3476401405 learned_addr learned my addr 172.21.15.57:0/3476401405 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.617 7fafca5fd700 1 --2- 172.21.15.57:0/3476401405 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1a59d0 0x7fafcc1a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafc3fff700 1 -- 172.21.15.57:0/3476401405 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1a59d0 msgr2=0x7fafcc1a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafc3fff700 1 --2- 172.21.15.57:0/3476401405 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1a59d0 0x7fafcc1a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafc3fff700 1 -- 172.21.15.57:0/3476401405 >> v1:172.21.15.57:6789/0 conn(0x7fafcc0f5a10 legacy=0x7fafcc10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafc3fff700 1 -- 172.21.15.57:0/3476401405 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc1a9470 con 0x7fafcc10b910 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafc3fff700 1 --2- 172.21.15.57:0/3476401405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc10b910 0x7fafcc1a53a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fafcc103a10 tx=0x7fafb400ba20).ready entity=mon.0 client_cookie=7719582b6573817c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafc95fb700 1 -- 172.21.15.57:0/3476401405 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafcc1a9470 con 0x7fafcc10b910 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafc95fb700 1 -- 172.21.15.57:0/3476401405 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400d5c0 con 0x7fafcc10b910 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafc95fb700 1 -- 172.21.15.57:0/3476401405 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafb400d990 con 0x7fafcc10b910 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafd10f0700 1 -- 172.21.15.57:0/3476401405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc10b910 msgr2=0x7fafcc1a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.618 7fafd10f0700 1 --2- 172.21.15.57:0/3476401405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc10b910 0x7fafcc1a53a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fafcc103a10 tx=0x7fafb400ba20).stop 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.619 7fafd10f0700 1 -- 172.21.15.57:0/3476401405 shutdown_connections 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.619 7fafd10f0700 1 --2- 172.21.15.57:0/3476401405 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1a59d0 0x7fafcc1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.619 7fafd10f0700 1 --2- 172.21.15.57:0/3476401405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc10b910 0x7fafcc1a53a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.619 7fafd10f0700 1 -- 172.21.15.57:0/3476401405 >> 172.21.15.57:0/3476401405 conn(0x7fafcc113a70 msgr2=0x7fafcc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.619 7fafd10f0700 1 -- 172.21.15.57:0/3476401405 shutdown_connections 2024-04-25T02:06:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.619 7fafd10f0700 1 -- 172.21.15.57:0/3476401405 wait complete. 2024-04-25T02:06:01.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafd10f0700 1 Processor -- start 2024-04-25T02:06:01.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafd10f0700 1 -- start start 2024-04-25T02:06:01.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafd10f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc0d9ed0 0x7fafcc0da320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafd10f0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafcc1b4700 0x7fafcc1b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafd10f0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1b5180 0x7fafcc1bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafd10f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0f50e0 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafd10f0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0d1540 con 0x7fafcc1b4700 2024-04-25T02:06:01.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafd10f0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0da950 con 0x7fafcc1b5180 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc9dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc0d9ed0 0x7fafcc0da320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafca5fd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1b5180 0x7fafcc1bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafcc1b4700 0x7fafcc1b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc9dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc0d9ed0 0x7fafcc0da320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60958/0 (socket says 172.21.15.57:60958) 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafca5fd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1b5180 0x7fafcc1bbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40212/0 (socket says 172.21.15.57:40212) 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafcc1b4700 0x7fafcc1b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47890/0 (socket says 172.21.15.57:47890) 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc9dfc700 1 -- 172.21.15.57:0/3038805210 learned_addr learned my addr 172.21.15.57:0/3038805210 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc9dfc700 1 -- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1b5180 msgr2=0x7fafcc1bbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc9dfc700 1 --2- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1b5180 0x7fafcc1bbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc9dfc700 1 -- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafcc1b4700 msgr2=0x7fafcc1b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc9dfc700 1 --2- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafcc1b4700 0x7fafcc1b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.643 7fafc9dfc700 1 -- 172.21.15.57:0/3038805210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc1b55d0 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.644 7fafc9dfc700 1 --2- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc0d9ed0 0x7fafcc0da320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fafcc0f24b0 tx=0x7fafbc00c810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.644 7fafc2ffd700 1 -- 172.21.15.57:0/3038805210 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafcc1b55d0 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.644 7fafc2ffd700 1 -- 172.21.15.57:0/3038805210 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc0072e0 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.644 7fafc2ffd700 1 -- 172.21.15.57:0/3038805210 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafbc005810 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.644 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc0de4e0 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.644 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc1bc210 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.644 7fafc2ffd700 1 -- 172.21.15.57:0/3038805210 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fafbc005a10 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.644 7fafc2ffd700 1 -- 172.21.15.57:0/3038805210 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fafbc0148d0 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.645 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc1a1960 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.648 7fafc2ffd700 1 -- 172.21.15.57:0/3038805210 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fafbc0070d0 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.792 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafcc0f08e0 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.792 7fafc2ffd700 1 -- 172.21.15.57:0/3038805210 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1702 (secure 0 0 0) 0x7fafbc000c30 con 0x7fafcc0d9ed0 2024-04-25T02:06:01.798 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:01.798 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:05:47.333033","modified":"2024-04-25 02:05:49.360768","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 >> v1:172.21.15.57:6816/43033 conn(0x7fafb00145b0 legacy=0x7fafb0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc0d9ed0 msgr2=0x7fafcc0da320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 --2- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc0d9ed0 0x7fafcc0da320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fafcc0f24b0 tx=0x7fafbc00c810).stop 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 shutdown_connections 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 --2- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fafcc1b5180 0x7fafcc1bbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 --2- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafcc0d9ed0 0x7fafcc0da320 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 --2- 172.21.15.57:0/3038805210 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafcc1b4700 0x7fafcc1b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 >> 172.21.15.57:0/3038805210 conn(0x7fafcc0c43d0 msgr2=0x7fafcc0d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 shutdown_connections 2024-04-25T02:06:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.794 7fafd10f0700 1 -- 172.21.15.57:0/3038805210 wait complete. 2024-04-25T02:06:01.801 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T02:06:01.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:01.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c37857700 1 Processor -- start 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c37857700 1 -- start start 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c37857700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c30106530 0x7f2c3010e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c37857700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3010ea90 0x7f2c300f1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c37857700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3010eee0 0x7f2c300f1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c37857700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c300fb670 con 0x7f2c30106530 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c37857700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30106980 con 0x7f2c3010eee0 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c37857700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300f1c60 con 0x7f2c3010ea90 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c2ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c30106530 0x7f2c3010e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c34e53700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3010eee0 0x7f2c300f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c2f7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3010ea90 0x7f2c300f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c2ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c30106530 0x7f2c3010e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60972/0 (socket says 172.21.15.57:60972) 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.936 7f2c2ffff700 1 -- 172.21.15.57:0/3575194440 learned_addr learned my addr 172.21.15.57:0/3575194440 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c34e53700 1 -- 172.21.15.57:0/3575194440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3010ea90 msgr2=0x7f2c300f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c34e53700 1 --2- 172.21.15.57:0/3575194440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3010ea90 0x7f2c300f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c34e53700 1 -- 172.21.15.57:0/3575194440 >> v2:172.21.15.57:3300/0 conn(0x7f2c30106530 msgr2=0x7f2c3010e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c34e53700 1 --2- 172.21.15.57:0/3575194440 >> v2:172.21.15.57:3300/0 conn(0x7f2c30106530 0x7f2c3010e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c34e53700 1 -- 172.21.15.57:0/3575194440 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300f1e90 con 0x7f2c3010eee0 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c2ffff700 1 --2- 172.21.15.57:0/3575194440 >> v2:172.21.15.57:3300/0 conn(0x7f2c30106530 0x7f2c3010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c2f7fe700 1 --2- 172.21.15.57:0/3575194440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3010ea90 0x7f2c300f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c34e53700 1 --2- 172.21.15.57:0/3575194440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3010eee0 0x7f2c300f1630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2c300f5980 tx=0x7f2c28009d40).ready entity=mon.1 client_cookie=ef325e8ceaf54340 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c2effd700 1 -- 172.21.15.57:0/3575194440 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c300f1e90 con 0x7f2c3010eee0 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c2effd700 1 -- 172.21.15.57:0/3575194440 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2800b7c0 con 0x7f2c3010eee0 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c2effd700 1 -- 172.21.15.57:0/3575194440 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c2800b9a0 con 0x7f2c3010eee0 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c37857700 1 -- 172.21.15.57:0/3575194440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3010eee0 msgr2=0x7f2c300f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.937 7f2c37857700 1 --2- 172.21.15.57:0/3575194440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3010eee0 0x7f2c300f1630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2c300f5980 tx=0x7f2c28009d40).stop 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.938 7f2c37857700 1 -- 172.21.15.57:0/3575194440 shutdown_connections 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.938 7f2c37857700 1 --2- 172.21.15.57:0/3575194440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3010eee0 0x7f2c300f1630 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.938 7f2c37857700 1 --2- 172.21.15.57:0/3575194440 >> v2:172.21.15.57:3300/0 conn(0x7f2c30106530 0x7f2c3010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.938 7f2c37857700 1 --2- 172.21.15.57:0/3575194440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3010ea90 0x7f2c300f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.938 7f2c37857700 1 -- 172.21.15.57:0/3575194440 >> 172.21.15.57:0/3575194440 conn(0x7f2c30114940 msgr2=0x7f2c30114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:01.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.938 7f2c37857700 1 -- 172.21.15.57:0/3575194440 shutdown_connections 2024-04-25T02:06:01.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.938 7f2c37857700 1 -- 172.21.15.57:0/3575194440 wait complete. 2024-04-25T02:06:01.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c37857700 1 Processor -- start 2024-04-25T02:06:01.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c37857700 1 -- start start 2024-04-25T02:06:01.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c37857700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c301ad8e0 0x7f2c301add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c37857700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c301ae360 0x7f2c301b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c37857700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c301b4880 0x7f2c301b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c37857700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300d7610 con 0x7f2c301ad8e0 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c37857700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300ce710 con 0x7f2c301ae360 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c37857700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300d80e0 con 0x7f2c301b4880 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c301ad8e0 0x7f2c301add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c301ad8e0 0x7f2c301add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60988/0 (socket says 172.21.15.57:60988) 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c34e53700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c301b4880 0x7f2c301b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c2ffff700 1 -- 172.21.15.57:0/40026576 learned_addr learned my addr 172.21.15.57:0/40026576 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.962 7f2c2f7fe700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c301ae360 0x7f2c301b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2ffff700 1 -- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c301b4880 msgr2=0x7f2c301b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2ffff700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c301b4880 0x7f2c301b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2ffff700 1 -- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c301ae360 msgr2=0x7f2c301b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2ffff700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c301ae360 0x7f2c301b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2ffff700 1 -- 172.21.15.57:0/40026576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c301bba50 con 0x7f2c301ad8e0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c34e53700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c301b4880 0x7f2c301b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2ffff700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c301ad8e0 0x7f2c301add30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2c300cea60 tx=0x7f2c2000ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2d7fa700 1 -- 172.21.15.57:0/40026576 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c301bba50 con 0x7f2c301ad8e0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2d7fa700 1 -- 172.21.15.57:0/40026576 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000ee40 con 0x7f2c301ad8e0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c37857700 1 -- 172.21.15.57:0/40026576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c301bbc50 con 0x7f2c301ad8e0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c2d7fa700 1 -- 172.21.15.57:0/40026576 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c2000f040 con 0x7f2c301ad8e0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.963 7f2c37857700 1 -- 172.21.15.57:0/40026576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c301bc030 con 0x7f2c301ad8e0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.964 7f2c2d7fa700 1 -- 172.21.15.57:0/40026576 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f2c20011070 con 0x7f2c301ad8e0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.964 7f2c2d7fa700 1 -- 172.21.15.57:0/40026576 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f2c20010040 con 0x7f2c301ad8e0 2024-04-25T02:06:01.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.964 7f2c37857700 1 -- 172.21.15.57:0/40026576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c300f08e0 con 0x7f2c301ad8e0 2024-04-25T02:06:01.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:01.967 7f2c2d7fa700 1 -- 172.21.15.57:0/40026576 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f2c2000c540 con 0x7f2c301ad8e0 2024-04-25T02:06:02.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.079 7f2c37857700 1 -- 172.21.15.57:0/40026576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c300d77c0 con 0x7f2c301ad8e0 2024-04-25T02:06:02.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.079 7f2c2d7fa700 1 -- 172.21.15.57:0/40026576 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8729 (secure 0 0 0) 0x7f2c20000c30 con 0x7f2c301ad8e0 2024-04-25T02:06:02.085 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:02.085 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":16,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:05:48.339447","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 -- 172.21.15.57:0/40026576 >> v1:172.21.15.57:6816/43033 conn(0x7f2c100145b0 legacy=0x7f2c10016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 -- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c301ad8e0 msgr2=0x7f2c301add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c301ad8e0 0x7f2c301add30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2c300cea60 tx=0x7f2c2000ed00).stop 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 -- 172.21.15.57:0/40026576 shutdown_connections 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c301b4880 0x7f2c301b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c301ad8e0 0x7f2c301add30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 --2- 172.21.15.57:0/40026576 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c301ae360 0x7f2c301b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 -- 172.21.15.57:0/40026576 >> 172.21.15.57:0/40026576 conn(0x7f2c300c5390 msgr2=0x7f2c300ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 -- 172.21.15.57:0/40026576 shutdown_connections 2024-04-25T02:06:02.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.081 7f2c37857700 1 -- 172.21.15.57:0/40026576 wait complete. 2024-04-25T02:06:02.098 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:02.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.223 7f000114e700 1 Processor -- start 2024-04-25T02:06:02.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.223 7f000114e700 1 -- start start 2024-04-25T02:06:02.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.223 7f000114e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc0f2090 0x7efffc1a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.223 7f000114e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc1a8c80 0x7efffc1ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.223 7f000114e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0f9230 con 0x7efffc0f5920 2024-04-25T02:06:02.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7f000114e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0f24e0 con 0x7efffc1a8c80 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7f000114e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efffc1ac720 con 0x7efffc0f2090 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff9dfc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efffc0f5920 0x7efffc0f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46902/0 (socket says 172.21.15.57:46902) 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff95fb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc0f2090 0x7efffc1a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff9dfc700 1 -- 172.21.15.57:0/2186910331 learned_addr learned my addr 172.21.15.57:0/2186910331 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efffa5fd700 1 --2- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc1a8c80 0x7efffc1ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff8dfa700 1 -- 172.21.15.57:0/2186910331 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034904670 0 0) 0x7effec001110 con 0x7efffc0f5920 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff8dfa700 1 -- 172.21.15.57:0/2186910331 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effdc003270 con 0x7efffc0f5920 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efffa5fd700 1 -- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc0f2090 msgr2=0x7efffc1a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efffa5fd700 1 --2- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc0f2090 0x7efffc1a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efffa5fd700 1 -- 172.21.15.57:0/2186910331 >> v1:172.21.15.57:6789/0 conn(0x7efffc0f5920 legacy=0x7efffc0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efffa5fd700 1 -- 172.21.15.57:0/2186910331 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc1ac8d0 con 0x7efffc1a8c80 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff95fb700 1 --2- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc0f2090 0x7efffc1a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efffa5fd700 1 --2- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc1a8c80 0x7efffc1ab0e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7efffc0f4640 tx=0x7efff4009d70).ready entity=mon.1 client_cookie=e51a7fe5c91f25fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff8dfa700 1 -- 172.21.15.57:0/2186910331 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efffc1ac8d0 con 0x7efffc1a8c80 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff8dfa700 1 -- 172.21.15.57:0/2186910331 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400b7c0 con 0x7efffc1a8c80 2024-04-25T02:06:02.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7efff8dfa700 1 -- 172.21.15.57:0/2186910331 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efff400b9a0 con 0x7efffc1a8c80 2024-04-25T02:06:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7f000114e700 1 -- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc1a8c80 msgr2=0x7efffc1ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.224 7f000114e700 1 --2- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc1a8c80 0x7efffc1ab0e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7efffc0f4640 tx=0x7efff4009d70).stop 2024-04-25T02:06:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.225 7f000114e700 1 -- 172.21.15.57:0/2186910331 shutdown_connections 2024-04-25T02:06:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.225 7f000114e700 1 --2- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc1a8c80 0x7efffc1ab0e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.225 7f000114e700 1 --2- 172.21.15.57:0/2186910331 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc0f2090 0x7efffc1a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.225 7f000114e700 1 -- 172.21.15.57:0/2186910331 >> 172.21.15.57:0/2186910331 conn(0x7efffc113a70 msgr2=0x7efffc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.225 7f000114e700 1 -- 172.21.15.57:0/2186910331 shutdown_connections 2024-04-25T02:06:02.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.225 7f000114e700 1 -- 172.21.15.57:0/2186910331 wait complete. 2024-04-25T02:06:02.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7f000114e700 1 Processor -- start 2024-04-25T02:06:02.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7f000114e700 1 -- start start 2024-04-25T02:06:02.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7f000114e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efffc0c8f90 0x7efffc1b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7f000114e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc1b5330 0x7efffc0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7f000114e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc0c69a0 0x7efffc1bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7f000114e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0cf4a0 con 0x7efffc0c8f90 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7f000114e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0c7410 con 0x7efffc0c69a0 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7f000114e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efffc1b5780 con 0x7efffc1b5330 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7efff9dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efffc0c8f90 0x7efffc1b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7efffa5fd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc0c69a0 0x7efffc1bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7efff9dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efffc0c8f90 0x7efffc1b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60998/0 (socket says 172.21.15.57:60998) 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7efff9dfc700 1 -- 172.21.15.57:0/2003219843 learned_addr learned my addr 172.21.15.57:0/2003219843 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.249 7efff95fb700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc1b5330 0x7efffc0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff9dfc700 1 -- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc1b5330 msgr2=0x7efffc0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff9dfc700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc1b5330 0x7efffc0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff9dfc700 1 -- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc0c69a0 msgr2=0x7efffc1bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff9dfc700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc0c69a0 0x7efffc1bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff9dfc700 1 -- 172.21.15.57:0/2003219843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0c6df0 con 0x7efffc0c8f90 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efffa5fd700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc0c69a0 0x7efffc1bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff95fb700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc1b5330 0x7efffc0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff9dfc700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efffc0c8f90 0x7efffc1b4d00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7effec000bc0 tx=0x7effec00c7e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff2ffd700 1 -- 172.21.15.57:0/2003219843 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efffc0c6df0 con 0x7efffc0c8f90 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff2ffd700 1 -- 172.21.15.57:0/2003219843 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec0072e0 con 0x7efffc0c8f90 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7f000114e700 1 -- 172.21.15.57:0/2003219843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc0c7110 con 0x7efffc0c8f90 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7efff2ffd700 1 -- 172.21.15.57:0/2003219843 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7effec005810 con 0x7efffc0c8f90 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.250 7f000114e700 1 -- 172.21.15.57:0/2003219843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc1bc550 con 0x7efffc0c8f90 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.251 7efff2ffd700 1 -- 172.21.15.57:0/2003219843 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7effec005a10 con 0x7efffc0c8f90 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.251 7efff2ffd700 1 -- 172.21.15.57:0/2003219843 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7effec014950 con 0x7efffc0c8f90 2024-04-25T02:06:02.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.251 7f000114e700 1 -- 172.21.15.57:0/2003219843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc0f08e0 con 0x7efffc0c8f90 2024-04-25T02:06:02.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.255 7efff2ffd700 1 -- 172.21.15.57:0/2003219843 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7effec0070d0 con 0x7efffc0c8f90 2024-04-25T02:06:02.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.397 7f000114e700 1 -- 172.21.15.57:0/2003219843 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efffc0e2430 con 0x7efffc0c8f90 2024-04-25T02:06:02.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.397 7efff2ffd700 1 -- 172.21.15.57:0/2003219843 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1702 (secure 0 0 0) 0x7efffc0fefc0 con 0x7efffc0c8f90 2024-04-25T02:06:02.403 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:02.403 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:05:47.333033","modified":"2024-04-25 02:05:49.360768","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:06:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.398 7f000114e700 1 -- 172.21.15.57:0/2003219843 >> v1:172.21.15.57:6816/43033 conn(0x7effe00145b0 legacy=0x7effe0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.398 7f000114e700 1 -- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efffc0c8f90 msgr2=0x7efffc1b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.398 7f000114e700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efffc0c8f90 0x7efffc1b4d00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7effec000bc0 tx=0x7effec00c7e0).stop 2024-04-25T02:06:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.398 7f000114e700 1 -- 172.21.15.57:0/2003219843 shutdown_connections 2024-04-25T02:06:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.398 7f000114e700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efffc0c69a0 0x7efffc1bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.398 7f000114e700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efffc0c8f90 0x7efffc1b4d00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.398 7f000114e700 1 --2- 172.21.15.57:0/2003219843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efffc1b5330 0x7efffc0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.398 7f000114e700 1 -- 172.21.15.57:0/2003219843 >> 172.21.15.57:0/2003219843 conn(0x7efffc0dcaa0 msgr2=0x7efffc0c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.399 7f000114e700 1 -- 172.21.15.57:0/2003219843 shutdown_connections 2024-04-25T02:06:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.399 7f000114e700 1 -- 172.21.15.57:0/2003219843 wait complete. 2024-04-25T02:06:02.405 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T02:06:02.516 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25 02:05:47.333033', 'modified': '2024-04-25 02:05:49.360768', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4215}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4215': {'gid': 4215, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6817/2179885968', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6817', 'nonce': 2179885968}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:06:02.516 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:06:02.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:06:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f8119bed700 1 Processor -- start 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f8119bed700 1 -- start start 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f8119bed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140f5890 0x7f811410c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f8119bed700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f811410c8e0 0x7f81140f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f8119bed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f811410cd30 0x7f81140f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f8119bed700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81140fa200 con 0x7f811410c8e0 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f8119bed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140f9530 con 0x7f81140f5890 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f8119bed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81140f2460 con 0x7f811410cd30 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f811285d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140f5890 0x7f811410c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f811305e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f811410cd30 0x7f81140f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f811285d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140f5890 0x7f811410c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47934/0 (socket says 172.21.15.57:47934) 2024-04-25T02:06:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f811205c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f811410c8e0 0x7f81140f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.643 7f811285d700 1 -- 172.21.15.57:0/2482410409 learned_addr learned my addr 172.21.15.57:0/2482410409 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811285d700 1 -- 172.21.15.57:0/2482410409 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f811410cd30 msgr2=0x7f81140f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811285d700 1 --2- 172.21.15.57:0/2482410409 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f811410cd30 0x7f81140f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811285d700 1 -- 172.21.15.57:0/2482410409 >> v2:172.21.15.57:3300/0 conn(0x7f811410c8e0 msgr2=0x7f81140f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811285d700 1 --2- 172.21.15.57:0/2482410409 >> v2:172.21.15.57:3300/0 conn(0x7f811410c8e0 0x7f81140f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811285d700 1 -- 172.21.15.57:0/2482410409 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140f2690 con 0x7f81140f5890 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811205c700 1 --2- 172.21.15.57:0/2482410409 >> v2:172.21.15.57:3300/0 conn(0x7f811410c8e0 0x7f81140f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811305e700 1 --2- 172.21.15.57:0/2482410409 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f811410cd30 0x7f81140f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811285d700 1 --2- 172.21.15.57:0/2482410409 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140f5890 0x7f811410c2b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8114113370 tx=0x7f8104009a80).ready entity=mon.1 client_cookie=e5f6f1ebd7312e98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811185b700 1 -- 172.21.15.57:0/2482410409 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81140f2690 con 0x7f81140f5890 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811185b700 1 -- 172.21.15.57:0/2482410409 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400f510 con 0x7f81140f5890 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f811185b700 1 -- 172.21.15.57:0/2482410409 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f810400f6f0 con 0x7f81140f5890 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f8119bed700 1 -- 172.21.15.57:0/2482410409 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140f5890 msgr2=0x7f811410c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.644 7f8119bed700 1 --2- 172.21.15.57:0/2482410409 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140f5890 0x7f811410c2b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8114113370 tx=0x7f8104009a80).stop 2024-04-25T02:06:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.645 7f8119bed700 1 -- 172.21.15.57:0/2482410409 shutdown_connections 2024-04-25T02:06:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.645 7f8119bed700 1 --2- 172.21.15.57:0/2482410409 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f811410cd30 0x7f81140f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.645 7f8119bed700 1 --2- 172.21.15.57:0/2482410409 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140f5890 0x7f811410c2b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.645 7f8119bed700 1 --2- 172.21.15.57:0/2482410409 >> v2:172.21.15.57:3300/0 conn(0x7f811410c8e0 0x7f81140f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.645 7f8119bed700 1 -- 172.21.15.57:0/2482410409 >> 172.21.15.57:0/2482410409 conn(0x7f81141139e0 msgr2=0x7f81140f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.645 7f8119bed700 1 -- 172.21.15.57:0/2482410409 shutdown_connections 2024-04-25T02:06:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.645 7f8119bed700 1 -- 172.21.15.57:0/2482410409 wait complete. 2024-04-25T02:06:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f8119bed700 1 Processor -- start 2024-04-25T02:06:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f8119bed700 1 -- start start 2024-04-25T02:06:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f8119bed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140c8c20 0x7f81140d5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f8119bed700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81140d5960 0x7f81141b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f8119bed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f81140d5db0 0x7f81141b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f8119bed700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140cd330 con 0x7f81140d5960 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f8119bed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81141b2fd0 con 0x7f81140c8c20 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f8119bed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81141b3200 con 0x7f81140d5db0 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f811285d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140c8c20 0x7f81140d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f811205c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81140d5960 0x7f81141b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f811305e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f81140d5db0 0x7f81141b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f811285d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140c8c20 0x7f81140d5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47938/0 (socket says 172.21.15.57:47938) 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.669 7f811285d700 1 -- 172.21.15.57:0/3284661447 learned_addr learned my addr 172.21.15.57:0/3284661447 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f811285d700 1 -- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f81140d5db0 msgr2=0x7f81141b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f811285d700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f81140d5db0 0x7f81141b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f811285d700 1 -- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81140d5960 msgr2=0x7f81141b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f811285d700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81140d5960 0x7f81141b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f811285d700 1 -- 172.21.15.57:0/3284661447 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81141b9a60 con 0x7f81140c8c20 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f811205c700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81140d5960 0x7f81141b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f811305e700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f81140d5db0 0x7f81141b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f811285d700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140c8c20 0x7f81140d5330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8114113370 tx=0x7f81040068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f810bfff700 1 -- 172.21.15.57:0/3284661447 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81141b9a60 con 0x7f81140c8c20 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f810bfff700 1 -- 172.21.15.57:0/3284661447 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104011610 con 0x7f81140c8c20 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f8119bed700 1 -- 172.21.15.57:0/3284661447 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81140f6300 con 0x7f81140c8c20 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f810bfff700 1 -- 172.21.15.57:0/3284661447 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81040119e0 con 0x7f81140c8c20 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f8119bed700 1 -- 172.21.15.57:0/3284661447 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81140f65f0 con 0x7f81140c8c20 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f810bfff700 1 -- 172.21.15.57:0/3284661447 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8104011be0 con 0x7f81140c8c20 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.670 7f810bfff700 1 -- 172.21.15.57:0/3284661447 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8104001b90 con 0x7f81140c8c20 2024-04-25T02:06:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.673 7f812c4a6b80 1 Processor -- start 2024-04-25T02:06:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.673 7f812c4a6b80 1 -- start start 2024-04-25T02:06:02.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f812c4a6b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef220 0x55b84daef670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f812c4a6b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84daefca0 0x55b84dae28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f812c4a6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84dae2f10 0x55b84dae3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f812c4a6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84da1ac80 con 0x55b84dae2f10 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f812c4a6b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b84da38a40 con 0x55b84daefca0 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f812c4a6b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b84da05e00 con 0x55b84daef220 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef220 0x55b84daef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811305e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84dae2f10 0x55b84dae3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef220 0x55b84daef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40270/0 (socket says 172.21.15.57:40270) 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 -- 172.21.15.57:0/4073323899 learned_addr learned my addr 172.21.15.57:0/4073323899 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811205c700 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84daefca0 0x55b84dae28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 -- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84daefca0 msgr2=0x55b84dae28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84daefca0 0x55b84dae28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 -- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84dae2f10 msgr2=0x55b84dae3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84dae2f10 0x55b84dae3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 -- 172.21.15.57:0/4073323899 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b84dab83a0 con 0x55b84daef220 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811305e700 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84dae2f10 0x55b84dae3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811205c700 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84daefca0 0x55b84dae28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.674 7f811285d700 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef220 0x55b84daef670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x55b84da2b4f0 tx=0x7f8104027540).ready entity=mon.2 client_cookie=4006635846b007b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f8119bed700 1 -- 172.21.15.57:0/4073323899 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b84dab83a0 con 0x55b84daef220 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f8119bed700 1 -- 172.21.15.57:0/4073323899 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104036030 con 0x55b84daef220 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f8119bed700 1 -- 172.21.15.57:0/4073323899 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f81140f65f0 con 0x55b84daef220 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 -- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef220 msgr2=0x55b84daef670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef220 0x55b84daef670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x55b84da2b4f0 tx=0x7f8104027540).stop 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 -- 172.21.15.57:0/4073323899 shutdown_connections 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84dae2f10 0x55b84dae3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef220 0x55b84daef670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 --2- 172.21.15.57:0/4073323899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84daefca0 0x55b84dae28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 -- 172.21.15.57:0/4073323899 >> 172.21.15.57:0/4073323899 conn(0x55b84dadbcc0 msgr2=0x55b84dafd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 -- 172.21.15.57:0/4073323899 shutdown_connections 2024-04-25T02:06:02.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.675 7f812c4a6b80 1 -- 172.21.15.57:0/4073323899 wait complete. 2024-04-25T02:06:02.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.676 7f812c4a6b80 1 -- start start 2024-04-25T02:06:02.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.676 7f812c4a6b80 1 Processor -- start 2024-04-25T02:06:02.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f812c4a6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84db03830 0x55b84db03c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f812c4a6b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84db042b0 0x55b84daef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f812c4a6b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef850 0x55b84db118c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f812c4a6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b84dae3180 con 0x55b84db03830 2024-04-25T02:06:02.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f812c4a6b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b84dae2a60 con 0x55b84db042b0 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f812c4a6b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b84dae2df0 con 0x55b84daef850 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f812c4a6b80 10 client.0 ll_register_callbacks cb 0x55b84da10d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84db03830 0x55b84db03c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84db03830 0x55b84db03c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32802/0 (socket says 172.21.15.57:32802) 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 -- 172.21.15.57:0/3955252612 learned_addr learned my addr 172.21.15.57:0/3955252612 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811305e700 1 --2- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef850 0x55b84db118c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 -- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef850 msgr2=0x55b84db118c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 --2- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef850 0x55b84db118c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 -- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84db042b0 msgr2=0x55b84daef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 --2- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84db042b0 0x55b84daef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 -- 172.21.15.57:0/3955252612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b84d928b60 con 0x55b84db03830 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f811285d700 1 --2- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84db03830 0x55b84db03c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x55b84da2b4f0 tx=0x7f8104006830).ready entity=mon.0 client_cookie=afb915c201a55184 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f80f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f80f1ffb700 1 -- 172.21.15.57:0/3955252612 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b84d928b60 con 0x55b84db03830 2024-04-25T02:06:02.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f80f1ffb700 1 -- 172.21.15.57:0/3955252612 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8104001540 con 0x55b84db03830 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.677 7f812c4a6b80 1 -- 172.21.15.57:0/3955252612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b84da23cd0 con 0x55b84db03830 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f80f1ffb700 1 -- 172.21.15.57:0/3955252612 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8104026b60 con 0x55b84db03830 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f812c4a6b80 10 client.4587 fetch_fsmap learned FSMap version 5 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f812c4a6b80 1 -- 172.21.15.57:0/3955252612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x55b84db11ef0 con 0x55b84db03830 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f80f1ffb700 1 -- 172.21.15.57:0/3955252612 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b84da23cd0 con 0x55b84db03830 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f80f1ffb700 1 -- 172.21.15.57:0/3955252612 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 5) v1 ==== 1025+0+0 (secure 0 0 0) 0x7f8104042070 con 0x55b84db03830 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f812c4a6b80 10 client.4587 fetch_fsmap finished waiting for FSMap version 5 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f812c4a6b80 10 client.4587 resolve_mds: resolved ID 'a' to GID 4215 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f812c4a6b80 20 client.4587 populate_metadata read hostname 'smithi057' 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f812c4a6b80 4 client.4587 mds_command: new command op to 4215 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f812c4a6b80 1 -- 172.21.15.57:0/3955252612 --> v1:172.21.15.57:6817/2179885968 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b84d91cba0 con 0x55b84db12300 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.678 7f80f1ffb700 10 client.4587 ms_handle_connect on v1:172.21.15.57:6817/2179885968 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f80f1ffb700 1 -- 172.21.15.57:0/3955252612 <== mds.0 v1:172.21.15.57:6817/2179885968 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55b84d91cba0 con 0x55b84db12300 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f80f1ffb700 10 client.4587 handle_command_reply: tid=0 2024-04-25T02:06:02.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 client.4587 shutdown 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 -- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84db03830 msgr2=0x55b84db03c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 --2- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84db03830 0x55b84db03c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x55b84da2b4f0 tx=0x7f8104006830).stop 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 -- 172.21.15.57:0/3955252612 shutdown_connections 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 --2- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b84daef850 0x55b84db118c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f80f1ffb700 0 client.4587 ms_handle_reset on v1:172.21.15.57:6817/2179885968 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 --2- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b84db03830 0x55b84db03c80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 --2- 172.21.15.57:0/3955252612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b84db042b0 0x55b84daef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 -- 172.21.15.57:0/3955252612 >> 172.21.15.57:0/3955252612 conn(0x55b84daf3980 msgr2=0x55b84daf9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 -- 172.21.15.57:0/3955252612 shutdown_connections 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 1 -- 172.21.15.57:0/3955252612 wait complete. 2024-04-25T02:06:02.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.679 7f812c4a6b80 20 client.4587 trim_cache size 0 max 16384 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 -- 172.21.15.57:0/3284661447 >> v1:172.21.15.57:6816/43033 conn(0x7f80f80145b0 legacy=0x7f80f8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 -- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140c8c20 msgr2=0x7f81140d5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140c8c20 0x7f81140d5330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8114113370 tx=0x7f81040068c0).stop 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 -- 172.21.15.57:0/3284661447 shutdown_connections 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f81140d5db0 0x7f81141b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81140c8c20 0x7f81140d5330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 --2- 172.21.15.57:0/3284661447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81140d5960 0x7f81141b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 -- 172.21.15.57:0/3284661447 >> 172.21.15.57:0/3284661447 conn(0x7f81140c6c70 msgr2=0x7f81140d6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 -- 172.21.15.57:0/3284661447 shutdown_connections 2024-04-25T02:06:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.689 7f80f3fff700 1 -- 172.21.15.57:0/3284661447 wait complete. 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:no valid command found; 10 closest matches: 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:injectargs [...] 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:config set 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:config unset 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:exit 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:respawn 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:session kill 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:cpu_profiler status|flush 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:session ls { [...]} 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:client ls { [...]} 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:session evict { [...]} 2024-04-25T02:06:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: invalid command 2024-04-25T02:06:02.704 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T02:06:02.705 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T02:06:02.716 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:06:02.716 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:06:02.716 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client nautilus' 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcec15ae700 1 Processor -- start 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcec15ae700 1 -- start start 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcec15ae700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0f5b50 0x7fcebc0f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcec15ae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcebc0f20f0 0x7fcebc10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcec15ae700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0f2540 0x7fcebc10eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcec15ae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc0f9460 con 0x7fcebc0f20f0 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcec15ae700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc10f140 con 0x7fcebc0f5b50 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcec15ae700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1aa890 con 0x7fcebc0f2540 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fceb9ab0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcebc0f20f0 0x7fcebc10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fcebaab2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0f2540 0x7fcebc10eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fceb9ab0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcebc0f20f0 0x7fcebc10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32812/0 (socket says 172.21.15.57:32812) 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.841 7fceb9ab0700 1 -- 172.21.15.57:0/3272935589 learned_addr learned my addr 172.21.15.57:0/3272935589 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceba2b1700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0f5b50 0x7fcebc0f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb9ab0700 1 -- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0f2540 msgr2=0x7fcebc10eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb9ab0700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0f2540 0x7fcebc10eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb9ab0700 1 -- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0f5b50 msgr2=0x7fcebc0f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb9ab0700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0f5b50 0x7fcebc0f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb9ab0700 1 -- 172.21.15.57:0/3272935589 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc1aaa40 con 0x7fcebc0f20f0 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fcebaab2700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0f2540 0x7fcebc10eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceba2b1700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0f5b50 0x7fcebc0f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb9ab0700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0f20f0 0x7fcebc10e4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fcebc103a20 tx=0x7fceb0009a80).ready entity=mon.0 client_cookie=bb791b5229ffead7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb92af700 1 -- 172.21.15.57:0/3272935589 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcebc1aaa40 con 0x7fcebc0f20f0 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb92af700 1 -- 172.21.15.57:0/3272935589 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb000f510 con 0x7fcebc0f20f0 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fceb92af700 1 -- 172.21.15.57:0/3272935589 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fceb000f6f0 con 0x7fcebc0f20f0 2024-04-25T02:06:02.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fcec15ae700 1 -- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0f20f0 msgr2=0x7fcebc10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.842 7fcec15ae700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0f20f0 0x7fcebc10e4e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fcebc103a20 tx=0x7fceb0009a80).stop 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.843 7fcec15ae700 1 -- 172.21.15.57:0/3272935589 shutdown_connections 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.843 7fcec15ae700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0f2540 0x7fcebc10eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.843 7fcec15ae700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0f5b50 0x7fcebc0f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.843 7fcec15ae700 1 --2- 172.21.15.57:0/3272935589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0f20f0 0x7fcebc10e4e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.843 7fcec15ae700 1 -- 172.21.15.57:0/3272935589 >> 172.21.15.57:0/3272935589 conn(0x7fcebc113ca0 msgr2=0x7fcebc0f5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.843 7fcec15ae700 1 -- 172.21.15.57:0/3272935589 shutdown_connections 2024-04-25T02:06:02.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.843 7fcec15ae700 1 -- 172.21.15.57:0/3272935589 wait complete. 2024-04-25T02:06:02.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcec15ae700 1 Processor -- start 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcec15ae700 1 -- start start 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcec15ae700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0d0d60 0x7fcebc0d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcec15ae700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0d17e0 0x7fcebc0def10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcec15ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0df540 0x7fcebc0df990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcec15ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0e6830 con 0x7fcebc0df540 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcec15ae700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0e0cd0 con 0x7fcebc0d0d60 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcec15ae700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0bde30 con 0x7fcebc0d17e0 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fceba2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0d0d60 0x7fcebc0d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fceb9ab0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0d17e0 0x7fcebc0def10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcebaab2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0df540 0x7fcebc0df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fceb9ab0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0d17e0 0x7fcebc0def10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40306/0 (socket says 172.21.15.57:40306) 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fcebaab2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0df540 0x7fcebc0df990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32818/0 (socket says 172.21.15.57:32818) 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fceba2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0d0d60 0x7fcebc0d11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47982/0 (socket says 172.21.15.57:47982) 2024-04-25T02:06:02.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.867 7fceb9ab0700 1 -- 172.21.15.57:0/1966785818 learned_addr learned my addr 172.21.15.57:0/1966785818 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceb9ab0700 1 -- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0d0d60 msgr2=0x7fcebc0d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceb9ab0700 1 --2- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0d0d60 0x7fcebc0d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceb9ab0700 1 -- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0df540 msgr2=0x7fcebc0df990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceb9ab0700 1 --2- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0df540 0x7fcebc0df990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceb9ab0700 1 -- 172.21.15.57:0/1966785818 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0bd620 con 0x7fcebc0d17e0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fcebaab2700 1 --2- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0df540 0x7fcebc0df990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceb9ab0700 1 --2- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0d17e0 0x7fcebc0def10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fcebc0deb40 tx=0x7fceb00068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceab7fe700 1 -- 172.21.15.57:0/1966785818 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcebc0bd620 con 0x7fcebc0d17e0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceab7fe700 1 -- 172.21.15.57:0/1966785818 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0011960 con 0x7fcebc0d17e0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc0bda10 con 0x7fcebc0d17e0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceab7fe700 1 -- 172.21.15.57:0/1966785818 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fceb0011d30 con 0x7fcebc0d17e0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc1bbb20 con 0x7fcebc0d17e0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceab7fe700 1 -- 172.21.15.57:0/1966785818 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fceb0027460 con 0x7fcebc0d17e0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.868 7fceab7fe700 1 -- 172.21.15.57:0/1966785818 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fceb00019f0 con 0x7fcebc0d17e0 2024-04-25T02:06:02.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.869 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc0f0b10 con 0x7fcebc0d17e0 2024-04-25T02:06:02.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.872 7fceab7fe700 1 -- 172.21.15.57:0/1966785818 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fceb000f300 con 0x7fcebc0d17e0 2024-04-25T02:06:02.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:02.992 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "nautilus"} v 0) v1 -- 0x7fcebc1aea80 con 0x7fcebc0d17e0 2024-04-25T02:06:03.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.847 7fceab7fe700 1 -- 172.21.15.57:0/1966785818 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "nautilus"}]=0 set require_min_compat_client to nautilus v17) v1 ==== 145+0+0 (secure 0 0 0) 0x7fceb0011750 con 0x7fcebc0d17e0 2024-04-25T02:06:03.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 >> v1:172.21.15.57:6816/43033 conn(0x7fce980145b0 legacy=0x7fce98016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:03.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0d17e0 msgr2=0x7fcebc0def10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:03.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 --2- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0d17e0 0x7fcebc0def10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fcebc0deb40 tx=0x7fceb00068c0).stop 2024-04-25T02:06:03.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 shutdown_connections 2024-04-25T02:06:03.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 --2- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcebc0df540 0x7fcebc0df990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:03.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 --2- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcebc0d0d60 0x7fcebc0d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:03.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 --2- 172.21.15.57:0/1966785818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcebc0d17e0 0x7fcebc0def10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:03.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 >> 172.21.15.57:0/1966785818 conn(0x7fcebc0c5b00 msgr2=0x7fcebc0c3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:03.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 shutdown_connections 2024-04-25T02:06:03.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:03.852 7fcec15ae700 1 -- 172.21.15.57:0/1966785818 wait complete. 2024-04-25T02:06:03.859 INFO:teuthology.orchestra.run.smithi057.stderr:set require_min_compat_client to nautilus 2024-04-25T02:06:03.871 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:06:03.879 INFO:teuthology.task.print:**** done ceph 2024-04-25T02:06:03.880 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T02:06:03.902 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T02:06:03.902 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-25T02:06:03.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:03.902 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-25T02:06:03.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:03.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-04-25T02:06:04.027 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2024-04-25T02:06:04.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:06:04.031 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T02:06:04.031 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:06:04.031 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:04.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:06:04.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.169 7f15280e0700 1 Processor -- start 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.169 7f15280e0700 1 -- start start 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15280e0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200f58a0 0x7f152010c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15280e0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f152010c8f0 0x7f15200f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15280e0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f152010cd40 0x7f15200f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15280e0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200fa210 con 0x7f152010cd40 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15280e0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200f9540 con 0x7f152010c8f0 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15280e0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15200f2470 con 0x7f15200f58a0 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f1524edb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200f58a0 0x7f152010c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f151ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f152010c8f0 0x7f15200f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15256dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f152010cd40 0x7f15200f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f151ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f152010c8f0 0x7f15200f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47990/0 (socket says 172.21.15.57:47990) 2024-04-25T02:06:04.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f1524edb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200f58a0 0x7f152010c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40310/0 (socket says 172.21.15.57:40310) 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15256dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f152010cd40 0x7f15200f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32832/0 (socket says 172.21.15.57:32832) 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f151ffff700 1 -- 172.21.15.57:0/2078973924 learned_addr learned my addr 172.21.15.57:0/2078973924 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f1524edb700 1 -- 172.21.15.57:0/2078973924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f152010c8f0 msgr2=0x7f15200f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f1524edb700 1 --2- 172.21.15.57:0/2078973924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f152010c8f0 0x7f15200f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f1524edb700 1 -- 172.21.15.57:0/2078973924 >> v2:172.21.15.57:3300/0 conn(0x7f152010cd40 msgr2=0x7f15200f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f1524edb700 1 --2- 172.21.15.57:0/2078973924 >> v2:172.21.15.57:3300/0 conn(0x7f152010cd40 0x7f15200f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f1524edb700 1 -- 172.21.15.57:0/2078973924 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200f26a0 con 0x7f15200f58a0 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f151ffff700 1 --2- 172.21.15.57:0/2078973924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f152010c8f0 0x7f15200f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.170 7f15256dc700 1 --2- 172.21.15.57:0/2078973924 >> v2:172.21.15.57:3300/0 conn(0x7f152010cd40 0x7f15200f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f1524edb700 1 --2- 172.21.15.57:0/2078973924 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200f58a0 0x7f152010c2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1508002f70 tx=0x7f150800b970).ready entity=mon.2 client_cookie=4ccbc22af74376cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f151f7fe700 1 -- 172.21.15.57:0/2078973924 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15200f26a0 con 0x7f15200f58a0 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f151f7fe700 1 -- 172.21.15.57:0/2078973924 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800d570 con 0x7f15200f58a0 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f151f7fe700 1 -- 172.21.15.57:0/2078973924 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f150800d940 con 0x7f15200f58a0 2024-04-25T02:06:04.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 -- 172.21.15.57:0/2078973924 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200f58a0 msgr2=0x7f152010c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 --2- 172.21.15.57:0/2078973924 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200f58a0 0x7f152010c2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f1508002f70 tx=0x7f150800b970).stop 2024-04-25T02:06:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 -- 172.21.15.57:0/2078973924 shutdown_connections 2024-04-25T02:06:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 --2- 172.21.15.57:0/2078973924 >> v2:172.21.15.57:3300/0 conn(0x7f152010cd40 0x7f15200f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 --2- 172.21.15.57:0/2078973924 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200f58a0 0x7f152010c2c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 --2- 172.21.15.57:0/2078973924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f152010c8f0 0x7f15200f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 -- 172.21.15.57:0/2078973924 >> 172.21.15.57:0/2078973924 conn(0x7f15201139f0 msgr2=0x7f15200f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 -- 172.21.15.57:0/2078973924 shutdown_connections 2024-04-25T02:06:04.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.171 7f15280e0700 1 -- 172.21.15.57:0/2078973924 wait complete. 2024-04-25T02:06:04.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.195 7f15280e0700 1 Processor -- start 2024-04-25T02:06:04.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f15280e0700 1 -- start start 2024-04-25T02:06:04.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f15280e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15200cf8b0 0x7f15200d5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f15280e0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15200d5ac0 0x7f15201b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f15280e0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200d5f10 0x7f15201b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f15280e0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15200ce930 con 0x7f15200cf8b0 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f15280e0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200cd2a0 con 0x7f15200d5ac0 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f15280e0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15201b3030 con 0x7f15200d5f10 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f1524edb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15200cf8b0 0x7f15200d5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f1524edb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15200cf8b0 0x7f15200d5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32838/0 (socket says 172.21.15.57:32838) 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f1524edb700 1 -- 172.21.15.57:0/312374250 learned_addr learned my addr 172.21.15.57:0/312374250 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f15256dc700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200d5f10 0x7f15201b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.196 7f151ffff700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15200d5ac0 0x7f15201b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151ffff700 1 -- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200d5f10 msgr2=0x7f15201b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151ffff700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200d5f10 0x7f15201b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151ffff700 1 -- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15200cf8b0 msgr2=0x7f15200d5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151ffff700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15200cf8b0 0x7f15200d5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151ffff700 1 -- 172.21.15.57:0/312374250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200f0180 con 0x7f15200d5ac0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f1524edb700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15200cf8b0 0x7f15200d5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f15256dc700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200d5f10 0x7f15201b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151ffff700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15200d5ac0 0x7f15201b23d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f15200c85b0 tx=0x7f151000eaa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151dffb700 1 -- 172.21.15.57:0/312374250 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15200f0180 con 0x7f15200d5ac0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151dffb700 1 -- 172.21.15.57:0/312374250 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1510012600 con 0x7f15200d5ac0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151dffb700 1 -- 172.21.15.57:0/312374250 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f151000f040 con 0x7f15200d5ac0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f15280e0700 1 -- 172.21.15.57:0/312374250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15201b3380 con 0x7f15200d5ac0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f15280e0700 1 -- 172.21.15.57:0/312374250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15201b9db0 con 0x7f15200d5ac0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151dffb700 1 -- 172.21.15.57:0/312374250 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1510011070 con 0x7f15200d5ac0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.197 7f151dffb700 1 -- 172.21.15.57:0/312374250 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1510010040 con 0x7f15200d5ac0 2024-04-25T02:06:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.198 7f15280e0700 1 -- 172.21.15.57:0/312374250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15200f0860 con 0x7f15200d5ac0 2024-04-25T02:06:04.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.201 7f151dffb700 1 -- 172.21.15.57:0/312374250 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f15100123f0 con 0x7f15200d5ac0 2024-04-25T02:06:04.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.343 7f15280e0700 1 -- 172.21.15.57:0/312374250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15201acb10 con 0x7f15200d5ac0 2024-04-25T02:06:04.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.344 7f151dffb700 1 -- 172.21.15.57:0/312374250 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1510000c30 con 0x7f15200d5ac0 2024-04-25T02:06:04.350 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:06:04.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 -- 172.21.15.57:0/312374250 >> v1:172.21.15.57:6816/43033 conn(0x7f15040145b0 legacy=0x7f1504016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:04.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 -- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15200d5ac0 msgr2=0x7f15201b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:04.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15200d5ac0 0x7f15201b23d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f15200c85b0 tx=0x7f151000eaa0).stop 2024-04-25T02:06:04.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 -- 172.21.15.57:0/312374250 shutdown_connections 2024-04-25T02:06:04.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f15200d5f10 0x7f15201b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15200cf8b0 0x7f15200d5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 --2- 172.21.15.57:0/312374250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15200d5ac0 0x7f15201b23d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:04.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 -- 172.21.15.57:0/312374250 >> 172.21.15.57:0/312374250 conn(0x7f15200c6d00 msgr2=0x7f15200c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:04.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 -- 172.21.15.57:0/312374250 shutdown_connections 2024-04-25T02:06:04.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:04.345 7f15280e0700 1 -- 172.21.15.57:0/312374250 wait complete. 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:06:04.362 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:06:04.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:04.363 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:04.410 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42581sec preferred_lft 42581sec 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2024-04-25T02:06:04.411 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:04.412 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:06:04.412 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:04.413 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-25T02:06:04.413 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:06:04.413 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2024-04-25T02:06:04.413 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2024-04-25T02:06:04.413 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:06:04.413 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-25T02:06:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:04.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:04.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:04.888 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:06:04.982 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-04-25T02:06:04.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:04.985 DEBUG:teuthology.orchestra.run.smithi088:> route 2024-04-25T02:06:05.053 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2024-04-25T02:06:05.054 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:06:05.054 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:06:05.054 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:06:05.054 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:06:05.054 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:05.055 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-25T02:06:05.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:06:05.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:06:05.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:06:05.055 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-25T02:06:05.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:05.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:05.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:05.786 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-25T02:06:05.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:05.832 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2024-04-25T02:06:05.917 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:05.917 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-25T02:06:05.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:06:05.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:06:05.917 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-25T02:06:06.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:06.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:06.144 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:06:06.144 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:06.144 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-25T02:06:06.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:06:06.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:06:06.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:06:06.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:06:06.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:06:06.145 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-25T02:06:06.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:06.448 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:06.448 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-25T02:06:06.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2024-04-25T02:06:06.449 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:06:06.449 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-25T02:06:06.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:06.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:06.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:06:06.665 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:06.709 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:06:06.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:06:06.710 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:06.792 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:06:06.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:06.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:06.926 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:06.926 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2024-04-25T02:06:06.926 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "norbytes", passing to kernel. 2024-04-25T02:06:06.926 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "mds_namespace", passing to kernel. 2024-04-25T02:06:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:06:07.656 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:07.656 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2024-04-25T02:06:07.656 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "norbytes", passing to kernel. 2024-04-25T02:06:07.657 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "mds_namespace", passing to kernel. 2024-04-25T02:06:07.662 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:06:07.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:07.662 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:07.730 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:07.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:07.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:07.895 INFO:teuthology.orchestra.run.smithi088.stdout:client4602 2024-04-25T02:06:07.895 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:06:07.895 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:07.939 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:08.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:08.136 INFO:teuthology.orchestra.run.smithi088.stdout:client4602 2024-04-25T02:06:08.137 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:08.293 INFO:teuthology.orchestra.run.smithi088.stdout:client4602 2024-04-25T02:06:08.293 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f8b8656c-c3d2-4264-b256-59947e4191e7.client4602/status') 2024-04-25T02:06:08.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:08.457 INFO:teuthology.orchestra.run.smithi088.stdout:instance: client.4602 (3)172.21.15.88:0/506421667 2024-04-25T02:06:08.458 INFO:teuthology.orchestra.run.smithi088.stdout:blocklisted: false 2024-04-25T02:06:08.458 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records in 2024-04-25T02:06:08.458 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records out 2024-04-25T02:06:08.459 INFO:teuthology.orchestra.run.smithi088.stderr:69 bytes copied, 6.2241e-05 s, 1.1 MB/s 2024-04-25T02:06:08.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:08.467 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T02:06:08.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:08.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.623 7fe88acdc700 1 Processor -- start 2024-04-25T02:06:08.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.623 7fe88acdc700 1 -- start start 2024-04-25T02:06:08.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe88acdc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840f3540 0x7fe8840f1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe88acdc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840f1fa0 0x7fe88410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe88acdc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8840f3990 con 0x7fe8840f23f0 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe88acdc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840f9560 con 0x7fe8840f3540 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe88acdc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840fa3c0 con 0x7fe8840f1fa0 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe8837fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840f3540 0x7fe8840f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe87affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840f1fa0 0x7fe88410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe8837fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840f3540 0x7fe8840f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36500/0 (socket says 172.21.15.57:36500) 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe8837fe700 1 -- 172.21.15.57:0/273993462 learned_addr learned my addr 172.21.15.57:0/273993462 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe8837fe700 1 -- 172.21.15.57:0/273993462 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840f1fa0 msgr2=0x7fe88410e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe8837fe700 1 --2- 172.21.15.57:0/273993462 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840f1fa0 0x7fe88410e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe8837fe700 1 -- 172.21.15.57:0/273993462 >> v1:172.21.15.57:6789/0 conn(0x7fe8840f23f0 legacy=0x7fe88410eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe882ffd700 1 -- 172.21.15.57:0/273993462 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998531136 0 0) 0x7fe8840f3990 con 0x7fe8840f23f0 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.624 7fe8837fe700 1 -- 172.21.15.57:0/273993462 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88410f2e0 con 0x7fe8840f3540 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe8837fe700 1 --2- 172.21.15.57:0/273993462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840f3540 0x7fe8840f1970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe8840f9710 tx=0x7fe874009ab0).ready entity=mon.1 client_cookie=a5d7ca8c5d08e7c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe882ffd700 1 -- 172.21.15.57:0/273993462 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe88410f2e0 con 0x7fe8840f3540 2024-04-25T02:06:08.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe882ffd700 1 -- 172.21.15.57:0/273993462 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87400f510 con 0x7fe8840f3540 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe882ffd700 1 -- 172.21.15.57:0/273993462 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe87400f6f0 con 0x7fe8840f3540 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe88acdc700 1 -- 172.21.15.57:0/273993462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840f3540 msgr2=0x7fe8840f1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe88acdc700 1 --2- 172.21.15.57:0/273993462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840f3540 0x7fe8840f1970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe8840f9710 tx=0x7fe874009ab0).stop 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe88acdc700 1 -- 172.21.15.57:0/273993462 shutdown_connections 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe88acdc700 1 --2- 172.21.15.57:0/273993462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840f3540 0x7fe8840f1970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe88acdc700 1 --2- 172.21.15.57:0/273993462 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840f1fa0 0x7fe88410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe88acdc700 1 -- 172.21.15.57:0/273993462 >> 172.21.15.57:0/273993462 conn(0x7fe884113a80 msgr2=0x7fe8840f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe88acdc700 1 -- 172.21.15.57:0/273993462 shutdown_connections 2024-04-25T02:06:08.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.625 7fe88acdc700 1 -- 172.21.15.57:0/273993462 wait complete. 2024-04-25T02:06:08.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.649 7fe88acdc700 1 Processor -- start 2024-04-25T02:06:08.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.649 7fe88acdc700 1 -- start start 2024-04-25T02:06:08.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe88acdc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840d5f40 0x7fe8840d6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe88acdc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840d69c0 0x7fe8841b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe88acdc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8841b4620 0x7fe8841b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe88acdc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840f0600 con 0x7fe8841b4620 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe88acdc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8841b50a0 con 0x7fe8840d5f40 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe88acdc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8841a8af0 con 0x7fe8840d69c0 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840d5f40 0x7fe8840d6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe87affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840d69c0 0x7fe8841b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840d5f40 0x7fe8840d6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36508/0 (socket says 172.21.15.57:36508) 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 -- 172.21.15.57:0/2863443314 learned_addr learned my addr 172.21.15.57:0/2863443314 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe883fff700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8841b4620 0x7fe8841b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 -- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840d69c0 msgr2=0x7fe8841b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840d69c0 0x7fe8841b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 -- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8841b4620 msgr2=0x7fe8841b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8841b4620 0x7fe8841b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 -- 172.21.15.57:0/2863443314 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8841a8fb0 con 0x7fe8840d5f40 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe883fff700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8841b4620 0x7fe8841b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:08.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.650 7fe8837fe700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840d5f40 0x7fe8840d6390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe8840c5000 tx=0x7fe8740068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:08.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.651 7fe8817fa700 1 -- 172.21.15.57:0/2863443314 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe8841a8fb0 con 0x7fe8840d5f40 2024-04-25T02:06:08.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.651 7fe8817fa700 1 -- 172.21.15.57:0/2863443314 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8740117a0 con 0x7fe8840d5f40 2024-04-25T02:06:08.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.651 7fe8817fa700 1 -- 172.21.15.57:0/2863443314 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe874011b70 con 0x7fe8840d5f40 2024-04-25T02:06:08.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.651 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8840ddc50 con 0x7fe8840d5f40 2024-04-25T02:06:08.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.651 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8841bb950 con 0x7fe8840d5f40 2024-04-25T02:06:08.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.651 7fe8817fa700 1 -- 172.21.15.57:0/2863443314 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe874019030 con 0x7fe8840d5f40 2024-04-25T02:06:08.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.651 7fe8817fa700 1 -- 172.21.15.57:0/2863443314 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe874018040 con 0x7fe8840d5f40 2024-04-25T02:06:08.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.652 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8841ae730 con 0x7fe8840d5f40 2024-04-25T02:06:08.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.655 7fe8817fa700 1 -- 172.21.15.57:0/2863443314 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe874011590 con 0x7fe8840d5f40 2024-04-25T02:06:08.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.767 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8840e2430 con 0x7fe8840d5f40 2024-04-25T02:06:08.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.767 7fe8817fa700 1 -- 172.21.15.57:0/2863443314 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7fe874037230 con 0x7fe8840d5f40 2024-04-25T02:06:08.773 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:08.773 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 >> v1:172.21.15.57:6816/43033 conn(0x7fe8680145b0 legacy=0x7fe868016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840d5f40 msgr2=0x7fe8840d6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840d5f40 0x7fe8840d6390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe8840c5000 tx=0x7fe8740068c0).stop 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 shutdown_connections 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8841b4620 0x7fe8841b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8840d5f40 0x7fe8840d6390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 --2- 172.21.15.57:0/2863443314 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8840d69c0 0x7fe8841b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 >> 172.21.15.57:0/2863443314 conn(0x7fe8840e1080 msgr2=0x7fe8840ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 shutdown_connections 2024-04-25T02:06:08.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.769 7fe88acdc700 1 -- 172.21.15.57:0/2863443314 wait complete. 2024-04-25T02:06:08.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:08.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:08.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.914 7f9224f95700 1 Processor -- start 2024-04-25T02:06:08.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f9224f95700 1 -- start start 2024-04-25T02:06:08.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f9224f95700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200f2090 0x7f92201a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f9224f95700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92201a8c80 0x7f92201ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f9224f95700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92200f9230 con 0x7f92200f5920 2024-04-25T02:06:08.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f9224f95700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92200f24e0 con 0x7f92200f2090 2024-04-25T02:06:08.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f9224f95700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92201ac720 con 0x7f92201a8c80 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f921dd77700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f92200f5920 0x7f92200f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51954/0 (socket says 172.21.15.57:51954) 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f921d576700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200f2090 0x7f92201a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f921dd77700 1 -- 172.21.15.57:0/7748167 learned_addr learned my addr 172.21.15.57:0/7748167 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.915 7f921e578700 1 --2- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92201a8c80 0x7f92201ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921d576700 1 -- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92201a8c80 msgr2=0x7f92201ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921d576700 1 --2- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92201a8c80 0x7f92201ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921cd75700 1 -- 172.21.15.57:0/7748167 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546086549 0 0) 0x7f9210001110 con 0x7f92200f5920 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921d576700 1 -- 172.21.15.57:0/7748167 >> v1:172.21.15.57:6789/0 conn(0x7f92200f5920 legacy=0x7f92200f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921d576700 1 -- 172.21.15.57:0/7748167 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92201ac8d0 con 0x7f92200f2090 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921e578700 1 --2- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92201a8c80 0x7f92201ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921d576700 1 --2- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200f2090 0x7f92201a8650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f92200f4640 tx=0x7f920800ba50).ready entity=mon.1 client_cookie=cd5afd646bfb0faf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921cd75700 1 -- 172.21.15.57:0/7748167 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92201ac8d0 con 0x7f92200f2090 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921cd75700 1 -- 172.21.15.57:0/7748167 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920800d570 con 0x7f92200f2090 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f921cd75700 1 -- 172.21.15.57:0/7748167 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f920800d940 con 0x7f92200f2090 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f9224f95700 1 -- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200f2090 msgr2=0x7f92201a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.916 7f9224f95700 1 --2- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200f2090 0x7f92201a8650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f92200f4640 tx=0x7f920800ba50).stop 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.917 7f9224f95700 1 -- 172.21.15.57:0/7748167 shutdown_connections 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.917 7f9224f95700 1 --2- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92201a8c80 0x7f92201ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.917 7f9224f95700 1 --2- 172.21.15.57:0/7748167 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200f2090 0x7f92201a8650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.917 7f9224f95700 1 -- 172.21.15.57:0/7748167 >> 172.21.15.57:0/7748167 conn(0x7f9220113a70 msgr2=0x7f92200f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.917 7f9224f95700 1 -- 172.21.15.57:0/7748167 shutdown_connections 2024-04-25T02:06:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.917 7f9224f95700 1 -- 172.21.15.57:0/7748167 wait complete. 2024-04-25T02:06:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f9224f95700 1 Processor -- start 2024-04-25T02:06:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f9224f95700 1 -- start start 2024-04-25T02:06:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f9224f95700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92200bc040 0x7f92201b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f9224f95700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92201b5480 0x7f92200c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f9224f95700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200c69a0 0x7f92201bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:08.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f9224f95700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92200e5d00 con 0x7f92201b5480 2024-04-25T02:06:08.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f9224f95700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92200d2be0 con 0x7f92200c69a0 2024-04-25T02:06:08.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f9224f95700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92201b58d0 con 0x7f92200bc040 2024-04-25T02:06:08.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921dd77700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92200bc040 0x7f92201b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921e578700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200c69a0 0x7f92201bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921dd77700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92200bc040 0x7f92201b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33068/0 (socket says 172.21.15.57:33068) 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921d576700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92201b5480 0x7f92200c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921dd77700 1 -- 172.21.15.57:0/1382939560 learned_addr learned my addr 172.21.15.57:0/1382939560 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921dd77700 1 -- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200c69a0 msgr2=0x7f92201bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921dd77700 1 --2- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200c69a0 0x7f92201bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921dd77700 1 -- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92201b5480 msgr2=0x7f92200c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921dd77700 1 --2- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92201b5480 0x7f92200c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.941 7f921dd77700 1 -- 172.21.15.57:0/1382939560 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200c73f0 con 0x7f92200bc040 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.942 7f921dd77700 1 --2- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92200bc040 0x7f92201b4e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f92200cca70 tx=0x7f921000c810).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.942 7f9216ffd700 1 -- 172.21.15.57:0/1382939560 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f92200c73f0 con 0x7f92200bc040 2024-04-25T02:06:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.942 7f9216ffd700 1 -- 172.21.15.57:0/1382939560 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92100072e0 con 0x7f92200bc040 2024-04-25T02:06:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.942 7f9224f95700 1 -- 172.21.15.57:0/1382939560 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92200c6df0 con 0x7f92200bc040 2024-04-25T02:06:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.942 7f9216ffd700 1 -- 172.21.15.57:0/1382939560 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9210005810 con 0x7f92200bc040 2024-04-25T02:06:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.942 7f9224f95700 1 -- 172.21.15.57:0/1382939560 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92201bc370 con 0x7f92200bc040 2024-04-25T02:06:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.942 7f9216ffd700 1 -- 172.21.15.57:0/1382939560 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9210005a10 con 0x7f92200bc040 2024-04-25T02:06:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.942 7f9216ffd700 1 -- 172.21.15.57:0/1382939560 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f92100149e0 con 0x7f92200bc040 2024-04-25T02:06:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.943 7f9224f95700 1 -- 172.21.15.57:0/1382939560 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92200f08e0 con 0x7f92200bc040 2024-04-25T02:06:08.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:08.946 7f9216ffd700 1 -- 172.21.15.57:0/1382939560 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f92100070d0 con 0x7f92200bc040 2024-04-25T02:06:09.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.057 7f9224f95700 1 -- 172.21.15.57:0/1382939560 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92200e2430 con 0x7f92200bc040 2024-04-25T02:06:09.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.058 7f9216ffd700 1 -- 172.21.15.57:0/1382939560 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9210000c30 con 0x7f92200bc040 2024-04-25T02:06:09.064 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 -- 172.21.15.57:0/1382939560 >> v1:172.21.15.57:6816/43033 conn(0x7f92040145b0 legacy=0x7f9204016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 -- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92200bc040 msgr2=0x7f92201b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 --2- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92200bc040 0x7f92201b4e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f92200cca70 tx=0x7f921000c810).stop 2024-04-25T02:06:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 -- 172.21.15.57:0/1382939560 shutdown_connections 2024-04-25T02:06:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 --2- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f92200c69a0 0x7f92201bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 --2- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92200bc040 0x7f92201b4e50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 --2- 172.21.15.57:0/1382939560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92201b5480 0x7f92200c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 -- 172.21.15.57:0/1382939560 >> 172.21.15.57:0/1382939560 conn(0x7f92200dc980 msgr2=0x7f92200c15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:09.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 -- 172.21.15.57:0/1382939560 shutdown_connections 2024-04-25T02:06:09.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.059 7f9224f95700 1 -- 172.21.15.57:0/1382939560 wait complete. 2024-04-25T02:06:09.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.204 7fbc3efd3700 1 Processor -- start 2024-04-25T02:06:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.204 7fbc3efd3700 1 -- start start 2024-04-25T02:06:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc3efd3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc380f5a10 0x7fbc3810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc3efd3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbc3810b740 0x7fbc3819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc3efd3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc381a0a70 con 0x7fbc3810bb90 2024-04-25T02:06:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc3efd3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380fa590 con 0x7fbc3810b740 2024-04-25T02:06:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc3efd3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381a0c90 con 0x7fbc380f5a10 2024-04-25T02:06:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc377fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc380f5a10 0x7fbc3810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc36ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbc3810b740 0x7fbc3819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc36ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbc3810b740 0x7fbc3819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60024/0 (socket says 172.21.15.57:60024) 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc377fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc380f5a10 0x7fbc3810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33078/0 (socket says 172.21.15.57:33078) 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc37fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbc3810bb90 0x7fbc381a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51958/0 (socket says 172.21.15.57:51958) 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc36ffd700 1 -- 172.21.15.57:0/3917822613 learned_addr learned my addr 172.21.15.57:0/3917822613 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc377fe700 1 -- 172.21.15.57:0/3917822613 >> v2:172.21.15.57:3300/0 conn(0x7fbc3810b740 msgr2=0x7fbc3819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc377fe700 1 --2- 172.21.15.57:0/3917822613 >> v2:172.21.15.57:3300/0 conn(0x7fbc3810b740 0x7fbc3819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc377fe700 1 -- 172.21.15.57:0/3917822613 >> v1:172.21.15.57:6789/0 conn(0x7fbc3810bb90 legacy=0x7fbc381a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc377fe700 1 -- 172.21.15.57:0/3917822613 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc381a93d0 con 0x7fbc380f5a10 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc36ffd700 1 --2- 172.21.15.57:0/3917822613 >> v2:172.21.15.57:3300/0 conn(0x7fbc3810b740 0x7fbc3819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc377fe700 1 --2- 172.21.15.57:0/3917822613 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc380f5a10 0x7fbc3810b110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fbc28002f70 tx=0x7fbc2800b970).ready entity=mon.2 client_cookie=2f9bb34c6fc2adbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc367fc700 1 -- 172.21.15.57:0/3917822613 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc381a93d0 con 0x7fbc380f5a10 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc367fc700 1 -- 172.21.15.57:0/3917822613 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2800d5c0 con 0x7fbc380f5a10 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc367fc700 1 -- 172.21.15.57:0/3917822613 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc2800d990 con 0x7fbc380f5a10 2024-04-25T02:06:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc3efd3700 1 -- 172.21.15.57:0/3917822613 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc380f5a10 msgr2=0x7fbc3810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.205 7fbc3efd3700 1 --2- 172.21.15.57:0/3917822613 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc380f5a10 0x7fbc3810b110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fbc28002f70 tx=0x7fbc2800b970).stop 2024-04-25T02:06:09.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.206 7fbc3efd3700 1 -- 172.21.15.57:0/3917822613 shutdown_connections 2024-04-25T02:06:09.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.206 7fbc3efd3700 1 --2- 172.21.15.57:0/3917822613 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc380f5a10 0x7fbc3810b110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.206 7fbc3efd3700 1 --2- 172.21.15.57:0/3917822613 >> v2:172.21.15.57:3300/0 conn(0x7fbc3810b740 0x7fbc3819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.206 7fbc3efd3700 1 -- 172.21.15.57:0/3917822613 >> 172.21.15.57:0/3917822613 conn(0x7fbc38113a70 msgr2=0x7fbc380f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:09.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.206 7fbc3efd3700 1 -- 172.21.15.57:0/3917822613 shutdown_connections 2024-04-25T02:06:09.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.206 7fbc3efd3700 1 -- 172.21.15.57:0/3917822613 wait complete. 2024-04-25T02:06:09.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.230 7fbc3efd3700 1 Processor -- start 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.230 7fbc3efd3700 1 -- start start 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.230 7fbc3efd3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc381addd0 0x7fbc381ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.230 7fbc3efd3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc381ae850 0x7fbc381b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.230 7fbc3efd3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc381b4d70 0x7fbc381b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.230 7fbc3efd3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380f1fb0 con 0x7fbc381b4d70 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.230 7fbc3efd3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380c4bc0 con 0x7fbc381addd0 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.230 7fbc3efd3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380f21f0 con 0x7fbc381ae850 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc381b4d70 0x7fbc381b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc36ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc381ae850 0x7fbc381b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc381b4d70 0x7fbc381b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60040/0 (socket says 172.21.15.57:60040) 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 -- 172.21.15.57:0/521406351 learned_addr learned my addr 172.21.15.57:0/521406351 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc36ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc381ae850 0x7fbc381b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33084/0 (socket says 172.21.15.57:33084) 2024-04-25T02:06:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc377fe700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc381addd0 0x7fbc381ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 -- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc381ae850 msgr2=0x7fbc381b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc381ae850 0x7fbc381b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 -- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc381addd0 msgr2=0x7fbc381ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc381addd0 0x7fbc381ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 -- 172.21.15.57:0/521406351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380f1a70 con 0x7fbc381b4d70 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc377fe700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc381addd0 0x7fbc381ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc37fff700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc381b4d70 0x7fbc381b51c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fbc30001250 tx=0x7fbc3000cb90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc34ff9700 1 -- 172.21.15.57:0/521406351 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc380f1a70 con 0x7fbc381b4d70 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc34ff9700 1 -- 172.21.15.57:0/521406351 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30005af0 con 0x7fbc381b4d70 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc381bbec0 con 0x7fbc381b4d70 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc34ff9700 1 -- 172.21.15.57:0/521406351 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbc30007110 con 0x7fbc381b4d70 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.231 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc381bc2a0 con 0x7fbc381b4d70 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.232 7fbc34ff9700 1 -- 172.21.15.57:0/521406351 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fbc3001a060 con 0x7fbc381b4d70 2024-04-25T02:06:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.232 7fbc34ff9700 1 -- 172.21.15.57:0/521406351 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fbc300055a0 con 0x7fbc381b4d70 2024-04-25T02:06:09.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.232 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380f08e0 con 0x7fbc381b4d70 2024-04-25T02:06:09.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.236 7fbc34ff9700 1 -- 172.21.15.57:0/521406351 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fbc300058e0 con 0x7fbc381b4d70 2024-04-25T02:06:09.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.346 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc381aee60 con 0x7fbc381b4d70 2024-04-25T02:06:09.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.346 7fbc34ff9700 1 -- 172.21.15.57:0/521406351 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc381145f0 con 0x7fbc381b4d70 2024-04-25T02:06:09.352 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:09.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 >> v1:172.21.15.57:6816/43033 conn(0x7fbc1c0145b0 legacy=0x7fbc1c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc381b4d70 msgr2=0x7fbc381b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc381b4d70 0x7fbc381b51c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fbc30001250 tx=0x7fbc3000cb90).stop 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 shutdown_connections 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc381b4d70 0x7fbc381b51c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc381addd0 0x7fbc381ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 --2- 172.21.15.57:0/521406351 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbc381ae850 0x7fbc381b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 >> 172.21.15.57:0/521406351 conn(0x7fbc380c6e10 msgr2=0x7fbc381a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 shutdown_connections 2024-04-25T02:06:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.348 7fbc3efd3700 1 -- 172.21.15.57:0/521406351 wait complete. 2024-04-25T02:06:09.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f84737d3700 1 Processor -- start 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f84737d3700 1 -- start start 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f84737d3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c0f5920 0x7f846c10c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f84737d3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f846c10c970 0x7f846c0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f84737d3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c10cdc0 0x7f846c0f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f84737d3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c0fa290 con 0x7f846c10c970 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f84737d3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0f95c0 con 0x7f846c0f5920 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f84737d3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0f24f0 con 0x7f846c10cdc0 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f8470dcf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c10cdc0 0x7f846c0f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f846b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f846c10c970 0x7f846c0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f846bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c0f5920 0x7f846c10c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f8470dcf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c10cdc0 0x7f846c0f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33098/0 (socket says 172.21.15.57:33098) 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f846b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f846c10c970 0x7f846c0f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60054/0 (socket says 172.21.15.57:60054) 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f846bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c0f5920 0x7f846c10c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36546/0 (socket says 172.21.15.57:36546) 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.492 7f8470dcf700 1 -- 172.21.15.57:0/1698094315 learned_addr learned my addr 172.21.15.57:0/1698094315 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f8470dcf700 1 -- 172.21.15.57:0/1698094315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c0f5920 msgr2=0x7f846c10c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f8470dcf700 1 --2- 172.21.15.57:0/1698094315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c0f5920 0x7f846c10c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f8470dcf700 1 -- 172.21.15.57:0/1698094315 >> v2:172.21.15.57:3300/0 conn(0x7f846c10c970 msgr2=0x7f846c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f8470dcf700 1 --2- 172.21.15.57:0/1698094315 >> v2:172.21.15.57:3300/0 conn(0x7f846c10c970 0x7f846c0f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f8470dcf700 1 -- 172.21.15.57:0/1698094315 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c0f2720 con 0x7f846c10cdc0 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f846b7fe700 1 --2- 172.21.15.57:0/1698094315 >> v2:172.21.15.57:3300/0 conn(0x7f846c10c970 0x7f846c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f846bfff700 1 --2- 172.21.15.57:0/1698094315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c0f5920 0x7f846c10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f8470dcf700 1 --2- 172.21.15.57:0/1698094315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c10cdc0 0x7f846c0f1ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f846c113400 tx=0x7f8464009dc0).ready entity=mon.2 client_cookie=21d59f4a18461ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f846affd700 1 -- 172.21.15.57:0/1698094315 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f846c0f2720 con 0x7f846c10cdc0 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f846affd700 1 -- 172.21.15.57:0/1698094315 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846400b8d0 con 0x7f846c10cdc0 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f846affd700 1 -- 172.21.15.57:0/1698094315 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f846400bab0 con 0x7f846c10cdc0 2024-04-25T02:06:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f84737d3700 1 -- 172.21.15.57:0/1698094315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c10cdc0 msgr2=0x7f846c0f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.493 7f84737d3700 1 --2- 172.21.15.57:0/1698094315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c10cdc0 0x7f846c0f1ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f846c113400 tx=0x7f8464009dc0).stop 2024-04-25T02:06:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.494 7f84737d3700 1 -- 172.21.15.57:0/1698094315 shutdown_connections 2024-04-25T02:06:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.494 7f84737d3700 1 --2- 172.21.15.57:0/1698094315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c10cdc0 0x7f846c0f1ec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.494 7f84737d3700 1 --2- 172.21.15.57:0/1698094315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c0f5920 0x7f846c10c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.494 7f84737d3700 1 --2- 172.21.15.57:0/1698094315 >> v2:172.21.15.57:3300/0 conn(0x7f846c10c970 0x7f846c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.494 7f84737d3700 1 -- 172.21.15.57:0/1698094315 >> 172.21.15.57:0/1698094315 conn(0x7f846c113a70 msgr2=0x7f846c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.494 7f84737d3700 1 -- 172.21.15.57:0/1698094315 shutdown_connections 2024-04-25T02:06:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.494 7f84737d3700 1 -- 172.21.15.57:0/1698094315 wait complete. 2024-04-25T02:06:09.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f84737d3700 1 Processor -- start 2024-04-25T02:06:09.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f84737d3700 1 -- start start 2024-04-25T02:06:09.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f84737d3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c1abbe0 0x7f846c1ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f84737d3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f846c1ac660 0x7f846c1b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f84737d3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c1b2cc0 0x7f846c1b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f84737d3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0a24d0 con 0x7f846c1ac660 2024-04-25T02:06:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f84737d3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0d78f0 con 0x7f846c1b2cc0 2024-04-25T02:06:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f84737d3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846c1b3740 con 0x7f846c1abbe0 2024-04-25T02:06:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f846bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c1abbe0 0x7f846c1ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f846b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f846c1ac660 0x7f846c1b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f846bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c1abbe0 0x7f846c1ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33112/0 (socket says 172.21.15.57:33112) 2024-04-25T02:06:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f846bfff700 1 -- 172.21.15.57:0/3203870803 learned_addr learned my addr 172.21.15.57:0/3203870803 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.518 7f8470dcf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c1b2cc0 0x7f846c1b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f846bfff700 1 -- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c1b2cc0 msgr2=0x7f846c1b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f846bfff700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c1b2cc0 0x7f846c1b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f846bfff700 1 -- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f846c1ac660 msgr2=0x7f846c1b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f846bfff700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f846c1ac660 0x7f846c1b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f846bfff700 1 -- 172.21.15.57:0/3203870803 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c0d3ac0 con 0x7f846c1abbe0 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f8470dcf700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c1b2cc0 0x7f846c1b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f846b7fe700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f846c1ac660 0x7f846c1b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f846bfff700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c1abbe0 0x7f846c1ac030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f846c0d4650 tx=0x7f845c00bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f84697fa700 1 -- 172.21.15.57:0/3203870803 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f846c0d3ac0 con 0x7f846c1abbe0 2024-04-25T02:06:09.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f84697fa700 1 -- 172.21.15.57:0/3203870803 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00ab80 con 0x7f846c1abbe0 2024-04-25T02:06:09.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f84737d3700 1 -- 172.21.15.57:0/3203870803 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c0c41c0 con 0x7f846c1abbe0 2024-04-25T02:06:09.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f84697fa700 1 -- 172.21.15.57:0/3203870803 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f845c016070 con 0x7f846c1abbe0 2024-04-25T02:06:09.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f84737d3700 1 -- 172.21.15.57:0/3203870803 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c0f6570 con 0x7f846c1abbe0 2024-04-25T02:06:09.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.519 7f84697fa700 1 -- 172.21.15.57:0/3203870803 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f845c0193c0 con 0x7f846c1abbe0 2024-04-25T02:06:09.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.520 7f84697fa700 1 -- 172.21.15.57:0/3203870803 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f845c002bf0 con 0x7f846c1abbe0 2024-04-25T02:06:09.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.520 7f84737d3700 1 -- 172.21.15.57:0/3203870803 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c0f08e0 con 0x7f846c1abbe0 2024-04-25T02:06:09.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.523 7f84697fa700 1 -- 172.21.15.57:0/3203870803 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f845c00a780 con 0x7f846c1abbe0 2024-04-25T02:06:09.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.633 7f84737d3700 1 -- 172.21.15.57:0/3203870803 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f846c1acd90 con 0x7f846c1abbe0 2024-04-25T02:06:09.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.634 7f84697fa700 1 -- 172.21.15.57:0/3203870803 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f845c000c30 con 0x7f846c1abbe0 2024-04-25T02:06:09.640 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 -- 172.21.15.57:0/3203870803 >> v1:172.21.15.57:6816/43033 conn(0x7f844c0145b0 legacy=0x7f844c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 -- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c1abbe0 msgr2=0x7f846c1ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c1abbe0 0x7f846c1ac030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f846c0d4650 tx=0x7f845c00bf70).stop 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 -- 172.21.15.57:0/3203870803 shutdown_connections 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f846c1b2cc0 0x7f846c1b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f846c1abbe0 0x7f846c1ac030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 --2- 172.21.15.57:0/3203870803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f846c1ac660 0x7f846c1b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 -- 172.21.15.57:0/3203870803 >> 172.21.15.57:0/3203870803 conn(0x7f846c0c91d0 msgr2=0x7f846c0c7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 -- 172.21.15.57:0/3203870803 shutdown_connections 2024-04-25T02:06:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.635 7f84737d3700 1 -- 172.21.15.57:0/3203870803 wait complete. 2024-04-25T02:06:09.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:09.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.779 7f444d666700 1 Processor -- start 2024-04-25T02:06:09.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.779 7f444d666700 1 -- start start 2024-04-25T02:06:09.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f444d666700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44480f5920 0x7f444810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f444d666700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f444810c970 0x7f44480f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f444d666700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f444810cdc0 0x7f44480f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f444d666700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44480fa290 con 0x7f44480f5920 2024-04-25T02:06:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f444d666700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44480f95c0 con 0x7f444810cdc0 2024-04-25T02:06:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f444d666700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44480f24f0 con 0x7f444810c970 2024-04-25T02:06:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f44462b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44480f5920 0x7f444810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f4446ab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f444810cdc0 0x7f44480f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f4446ab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f444810cdc0 0x7f44480f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36562/0 (socket says 172.21.15.57:36562) 2024-04-25T02:06:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f44462b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44480f5920 0x7f444810c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60074/0 (socket says 172.21.15.57:60074) 2024-04-25T02:06:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f4446ab2700 1 -- 172.21.15.57:0/2325500236 learned_addr learned my addr 172.21.15.57:0/2325500236 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f443dab0700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f444810c970 0x7f44480f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f44462b1700 1 -- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f444810c970 msgr2=0x7f44480f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f44462b1700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f444810c970 0x7f44480f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f44462b1700 1 -- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f444810cdc0 msgr2=0x7f44480f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f44462b1700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f444810cdc0 0x7f44480f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f44462b1700 1 -- 172.21.15.57:0/2325500236 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44480f2720 con 0x7f44480f5920 2024-04-25T02:06:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f4446ab2700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f444810cdc0 0x7f44480f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.780 7f44462b1700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44480f5920 0x7f444810c340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f4448113400 tx=0x7f443800ba20).ready entity=mon.0 client_cookie=7c91a9e80c0e9d15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f4445ab0700 1 -- 172.21.15.57:0/2325500236 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44480f2720 con 0x7f44480f5920 2024-04-25T02:06:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f4445ab0700 1 -- 172.21.15.57:0/2325500236 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443800d570 con 0x7f44480f5920 2024-04-25T02:06:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f4445ab0700 1 -- 172.21.15.57:0/2325500236 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f443800d940 con 0x7f44480f5920 2024-04-25T02:06:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 -- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44480f5920 msgr2=0x7f444810c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44480f5920 0x7f444810c340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f4448113400 tx=0x7f443800ba20).stop 2024-04-25T02:06:09.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 -- 172.21.15.57:0/2325500236 shutdown_connections 2024-04-25T02:06:09.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f444810cdc0 0x7f44480f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44480f5920 0x7f444810c340 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 --2- 172.21.15.57:0/2325500236 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f444810c970 0x7f44480f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 -- 172.21.15.57:0/2325500236 >> 172.21.15.57:0/2325500236 conn(0x7f4448113a70 msgr2=0x7f44480f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:09.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 -- 172.21.15.57:0/2325500236 shutdown_connections 2024-04-25T02:06:09.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.781 7f444d666700 1 -- 172.21.15.57:0/2325500236 wait complete. 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.805 7f444d666700 1 Processor -- start 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.805 7f444d666700 1 -- start start 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f444d666700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44481af1f0 0x7f44481af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f444d666700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f44481b2510 0x7f44481b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f444d666700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44481b2f90 0x7f44481b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f444d666700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44480cb890 con 0x7f44481af1f0 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f444d666700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44480ce0d0 con 0x7f44481b2f90 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f444d666700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44481afc70 con 0x7f44481b2510 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f44462b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44481af1f0 0x7f44481af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443dab0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f44481b2510 0x7f44481b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f44462b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44481af1f0 0x7f44481af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60078/0 (socket says 172.21.15.57:60078) 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f44462b1700 1 -- 172.21.15.57:0/1762203267 learned_addr learned my addr 172.21.15.57:0/1762203267 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f4446ab2700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44481b2f90 0x7f44481b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443dab0700 1 -- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44481b2f90 msgr2=0x7f44481b99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443dab0700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44481b2f90 0x7f44481b99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443dab0700 1 -- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44481af1f0 msgr2=0x7f44481af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443dab0700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44481af1f0 0x7f44481af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443dab0700 1 -- 172.21.15.57:0/1762203267 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44480f0200 con 0x7f44481b2510 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f44462b1700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44481af1f0 0x7f44481af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443dab0700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f44481b2510 0x7f44481b2960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f44480c7600 tx=0x7f443000ec50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443ffff700 1 -- 172.21.15.57:0/1762203267 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f44480f0200 con 0x7f44481b2510 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443ffff700 1 -- 172.21.15.57:0/1762203267 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443000ee60 con 0x7f44481b2510 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f444d666700 1 -- 172.21.15.57:0/1762203267 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44481b33e0 con 0x7f44481b2510 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f443ffff700 1 -- 172.21.15.57:0/1762203267 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f443000f040 con 0x7f44481b2510 2024-04-25T02:06:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.806 7f444d666700 1 -- 172.21.15.57:0/1762203267 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44481ba200 con 0x7f44481b2510 2024-04-25T02:06:09.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.807 7f443ffff700 1 -- 172.21.15.57:0/1762203267 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4430011070 con 0x7f44481b2510 2024-04-25T02:06:09.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.807 7f443ffff700 1 -- 172.21.15.57:0/1762203267 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f4430010040 con 0x7f44481b2510 2024-04-25T02:06:09.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.808 7f444d666700 1 -- 172.21.15.57:0/1762203267 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44480f08e0 con 0x7f44481b2510 2024-04-25T02:06:09.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.811 7f443ffff700 1 -- 172.21.15.57:0/1762203267 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f443000c620 con 0x7f44481b2510 2024-04-25T02:06:09.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.921 7f444d666700 1 -- 172.21.15.57:0/1762203267 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44480e2430 con 0x7f44481b2510 2024-04-25T02:06:09.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.922 7f443ffff700 1 -- 172.21.15.57:0/1762203267 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f4430000c30 con 0x7f44481b2510 2024-04-25T02:06:09.928 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:09.928 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:09.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 -- 172.21.15.57:0/1762203267 >> v1:172.21.15.57:6816/43033 conn(0x7f442c0145b0 legacy=0x7f442c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 -- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f44481b2510 msgr2=0x7f44481b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:09.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f44481b2510 0x7f44481b2960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f44480c7600 tx=0x7f443000ec50).stop 2024-04-25T02:06:09.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 -- 172.21.15.57:0/1762203267 shutdown_connections 2024-04-25T02:06:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44481b2f90 0x7f44481b99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44481af1f0 0x7f44481af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 --2- 172.21.15.57:0/1762203267 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f44481b2510 0x7f44481b2960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 -- 172.21.15.57:0/1762203267 >> 172.21.15.57:0/1762203267 conn(0x7f44480cfb50 msgr2=0x7f44481a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 -- 172.21.15.57:0/1762203267 shutdown_connections 2024-04-25T02:06:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:09.923 7f444d666700 1 -- 172.21.15.57:0/1762203267 wait complete. 2024-04-25T02:06:09.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:09.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:10.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.068 7f5906fcc700 1 Processor -- start 2024-04-25T02:06:10.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.068 7f5906fcc700 1 -- start start 2024-04-25T02:06:10.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f5906fcc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59000f5a10 0x7f590010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f5906fcc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f590010b740 0x7f590019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f5906fcc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59001a0a70 con 0x7f590010bb90 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f5906fcc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59000fa590 con 0x7f59000f5a10 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f5906fcc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59001a0c90 con 0x7f590010b740 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58feffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f590010b740 0x7f590019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58ff7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59000f5a10 0x7f590010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58fffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f590010bb90 0x7f59001a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51964/0 (socket says 172.21.15.57:51964) 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58fffff700 1 -- 172.21.15.57:0/444017853 learned_addr learned my addr 172.21.15.57:0/444017853 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58feffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f590010b740 0x7f590019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36576/0 (socket says 172.21.15.57:36576) 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58ff7fe700 1 -- 172.21.15.57:0/444017853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f590010b740 msgr2=0x7f590019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58ff7fe700 1 --2- 172.21.15.57:0/444017853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f590010b740 0x7f590019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58ff7fe700 1 -- 172.21.15.57:0/444017853 >> v1:172.21.15.57:6789/0 conn(0x7f590010bb90 legacy=0x7f59001a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58fe7fc700 1 -- 172.21.15.57:0/444017853 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114035466 0 0) 0x7f58f8001490 con 0x7f590010bb90 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58ff7fe700 1 -- 172.21.15.57:0/444017853 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59001a93d0 con 0x7f59000f5a10 2024-04-25T02:06:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.069 7f58feffd700 1 --2- 172.21.15.57:0/444017853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f590010b740 0x7f590019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f58ff7fe700 1 --2- 172.21.15.57:0/444017853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000f5a10 0x7f590010b110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f590010f920 tx=0x7f58f000ba20).ready entity=mon.0 client_cookie=ec68b3d2ea4cb8a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f58fe7fc700 1 -- 172.21.15.57:0/444017853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59001a93d0 con 0x7f59000f5a10 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f58fe7fc700 1 -- 172.21.15.57:0/444017853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f000d5c0 con 0x7f59000f5a10 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f58fe7fc700 1 -- 172.21.15.57:0/444017853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58f000d990 con 0x7f59000f5a10 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f5906fcc700 1 -- 172.21.15.57:0/444017853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000f5a10 msgr2=0x7f590010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f5906fcc700 1 --2- 172.21.15.57:0/444017853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000f5a10 0x7f590010b110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f590010f920 tx=0x7f58f000ba20).stop 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f5906fcc700 1 -- 172.21.15.57:0/444017853 shutdown_connections 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f5906fcc700 1 --2- 172.21.15.57:0/444017853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000f5a10 0x7f590010b110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f5906fcc700 1 --2- 172.21.15.57:0/444017853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f590010b740 0x7f590019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f5906fcc700 1 -- 172.21.15.57:0/444017853 >> 172.21.15.57:0/444017853 conn(0x7f5900113a70 msgr2=0x7f59000f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f5906fcc700 1 -- 172.21.15.57:0/444017853 shutdown_connections 2024-04-25T02:06:10.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.070 7f5906fcc700 1 -- 172.21.15.57:0/444017853 wait complete. 2024-04-25T02:06:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.093 7f5906fcc700 1 Processor -- start 2024-04-25T02:06:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.093 7f5906fcc700 1 -- start start 2024-04-25T02:06:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f5906fcc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59000d3b80 0x7f59000ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f5906fcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000cea20 0x7f59001b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f5906fcc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59000cee70 0x7f59001b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f5906fcc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59000e29d0 con 0x7f59000cea20 2024-04-25T02:06:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f5906fcc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59000dd020 con 0x7f59000cee70 2024-04-25T02:06:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f5906fcc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59000d3fd0 con 0x7f59000d3b80 2024-04-25T02:06:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58ff7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59000d3b80 0x7f59000ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000cea20 0x7f59001b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000cea20 0x7f59001b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60090/0 (socket says 172.21.15.57:60090) 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58ff7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59000d3b80 0x7f59000ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33156/0 (socket says 172.21.15.57:33156) 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58fffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59000cee70 0x7f59001b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 -- 172.21.15.57:0/639815683 learned_addr learned my addr 172.21.15.57:0/639815683 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 -- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59000d3b80 msgr2=0x7f59000ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59000d3b80 0x7f59000ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 -- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59000cee70 msgr2=0x7f59001b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59000cee70 0x7f59001b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 -- 172.21.15.57:0/639815683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59001b5350 con 0x7f59000cea20 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58fffff700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59000cee70 0x7f59001b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58ff7fe700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59000d3b80 0x7f59000ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58feffd700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000cea20 0x7f59001b46f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f59000c5f70 tx=0x7f58e800ee40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58fcff9700 1 -- 172.21.15.57:0/639815683 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59001b5350 con 0x7f59000cea20 2024-04-25T02:06:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58fcff9700 1 -- 172.21.15.57:0/639815683 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800c9f0 con 0x7f59000cea20 2024-04-25T02:06:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f58fcff9700 1 -- 172.21.15.57:0/639815683 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58e800cdc0 con 0x7f59000cea20 2024-04-25T02:06:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f5906fcc700 1 -- 172.21.15.57:0/639815683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59001b5670 con 0x7f59000cea20 2024-04-25T02:06:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.094 7f5906fcc700 1 -- 172.21.15.57:0/639815683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59001bc0d0 con 0x7f59000cea20 2024-04-25T02:06:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.095 7f58fcff9700 1 -- 172.21.15.57:0/639815683 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f58e8020060 con 0x7f59000cea20 2024-04-25T02:06:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.095 7f58fcff9700 1 -- 172.21.15.57:0/639815683 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f58e8001bc0 con 0x7f59000cea20 2024-04-25T02:06:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.095 7f5906fcc700 1 -- 172.21.15.57:0/639815683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59000f08e0 con 0x7f59000cea20 2024-04-25T02:06:10.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.099 7f58fcff9700 1 -- 172.21.15.57:0/639815683 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f58e800c7e0 con 0x7f59000cea20 2024-04-25T02:06:10.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.209 7f5906fcc700 1 -- 172.21.15.57:0/639815683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59001aee10 con 0x7f59000cea20 2024-04-25T02:06:10.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.210 7f58fcff9700 1 -- 172.21.15.57:0/639815683 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f58e8000c30 con 0x7f59000cea20 2024-04-25T02:06:10.217 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:10.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 -- 172.21.15.57:0/639815683 >> v1:172.21.15.57:6816/43033 conn(0x7f58e40145b0 legacy=0x7f58e4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 -- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000cea20 msgr2=0x7f59001b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000cea20 0x7f59001b46f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f59000c5f70 tx=0x7f58e800ee40).stop 2024-04-25T02:06:10.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 -- 172.21.15.57:0/639815683 shutdown_connections 2024-04-25T02:06:10.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59000cee70 0x7f59001b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59000d3b80 0x7f59000ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 --2- 172.21.15.57:0/639815683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59000cea20 0x7f59001b46f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 -- 172.21.15.57:0/639815683 >> 172.21.15.57:0/639815683 conn(0x7f59000c4ab0 msgr2=0x7f59000e0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:10.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 -- 172.21.15.57:0/639815683 shutdown_connections 2024-04-25T02:06:10.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.211 7f5906fcc700 1 -- 172.21.15.57:0/639815683 wait complete. 2024-04-25T02:06:10.229 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:10.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.355 7efcc4521700 1 Processor -- start 2024-04-25T02:06:10.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.355 7efcc4521700 1 -- start start 2024-04-25T02:06:10.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc4521700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efcbc10b910 0x7efcbc1a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc4521700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc1a59d0 0x7efcbc1a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc4521700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc10bd60 con 0x7efcbc0f5a10 2024-04-25T02:06:10.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc4521700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc0fa590 con 0x7efcbc10b910 2024-04-25T02:06:10.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc4521700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1a0c50 con 0x7efcbc1a59d0 2024-04-25T02:06:10.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc0b1b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efcbc10b910 0x7efcbc1a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc1b1d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc1a59d0 0x7efcbc1a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc131c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efcbc0f5a10 0x7efcbc10b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51970/0 (socket says 172.21.15.57:51970) 2024-04-25T02:06:10.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc0b1b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efcbc10b910 0x7efcbc1a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60100/0 (socket says 172.21.15.57:60100) 2024-04-25T02:06:10.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc1b1d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc1a59d0 0x7efcbc1a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36586/0 (socket says 172.21.15.57:36586) 2024-04-25T02:06:10.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc131c700 1 -- 172.21.15.57:0/113129499 learned_addr learned my addr 172.21.15.57:0/113129499 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:10.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc0b1b700 1 -- 172.21.15.57:0/113129499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc1a59d0 msgr2=0x7efcbc1a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:10.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc0b1b700 1 --2- 172.21.15.57:0/113129499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc1a59d0 0x7efcbc1a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc0b1b700 1 -- 172.21.15.57:0/113129499 >> v1:172.21.15.57:6789/0 conn(0x7efcbc0f5a10 legacy=0x7efcbc10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcabfff700 1 -- 172.21.15.57:0/113129499 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656086571 0 0) 0x7efcac001110 con 0x7efcbc0f5a10 2024-04-25T02:06:10.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc0b1b700 1 -- 172.21.15.57:0/113129499 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc1a9470 con 0x7efcbc10b910 2024-04-25T02:06:10.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc1b1d700 1 --2- 172.21.15.57:0/113129499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc1a59d0 0x7efcbc1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc0b1b700 1 --2- 172.21.15.57:0/113129499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc10b910 0x7efcbc1a53a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7efcbc103a10 tx=0x7efcb800ba20).ready entity=mon.0 client_cookie=19f7a084b8b8d1bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:10.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcabfff700 1 -- 172.21.15.57:0/113129499 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efcbc1a9470 con 0x7efcbc10b910 2024-04-25T02:06:10.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcabfff700 1 -- 172.21.15.57:0/113129499 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb800d5c0 con 0x7efcbc10b910 2024-04-25T02:06:10.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcabfff700 1 -- 172.21.15.57:0/113129499 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efcb800d990 con 0x7efcbc10b910 2024-04-25T02:06:10.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc4521700 1 -- 172.21.15.57:0/113129499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc10b910 msgr2=0x7efcbc1a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.356 7efcc4521700 1 --2- 172.21.15.57:0/113129499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc10b910 0x7efcbc1a53a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7efcbc103a10 tx=0x7efcb800ba20).stop 2024-04-25T02:06:10.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.357 7efcc4521700 1 -- 172.21.15.57:0/113129499 shutdown_connections 2024-04-25T02:06:10.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.357 7efcc4521700 1 --2- 172.21.15.57:0/113129499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc1a59d0 0x7efcbc1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.357 7efcc4521700 1 --2- 172.21.15.57:0/113129499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc10b910 0x7efcbc1a53a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.357 7efcc4521700 1 -- 172.21.15.57:0/113129499 >> 172.21.15.57:0/113129499 conn(0x7efcbc113a70 msgr2=0x7efcbc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:10.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.357 7efcc4521700 1 -- 172.21.15.57:0/113129499 shutdown_connections 2024-04-25T02:06:10.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.357 7efcc4521700 1 -- 172.21.15.57:0/113129499 wait complete. 2024-04-25T02:06:10.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc4521700 1 Processor -- start 2024-04-25T02:06:10.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc4521700 1 -- start start 2024-04-25T02:06:10.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc4521700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc0d7920 0x7efcbc0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc4521700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0cea20 0x7efcbc1b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc4521700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0cee70 0x7efcbc1b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc4521700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0e6530 con 0x7efcbc0d7920 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc4521700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0d7080 con 0x7efcbc0cea20 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc4521700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0d72c0 con 0x7efcbc0cee70 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.381 7efcc131c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc0d7920 0x7efcbc0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc1b1d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0cee70 0x7efcbc1b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc131c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc0d7920 0x7efcbc0ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60110/0 (socket says 172.21.15.57:60110) 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc131c700 1 -- 172.21.15.57:0/17235193 learned_addr learned my addr 172.21.15.57:0/17235193 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc0b1b700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0cea20 0x7efcbc1b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc131c700 1 -- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0cee70 msgr2=0x7efcbc1b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc131c700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0cee70 0x7efcbc1b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc131c700 1 -- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0cea20 msgr2=0x7efcbc1b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc131c700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0cea20 0x7efcbc1b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc131c700 1 -- 172.21.15.57:0/17235193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc1b0e30 con 0x7efcbc0d7920 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc1b1d700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0cee70 0x7efcbc1b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc131c700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc0d7920 0x7efcbc0ce3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7efcbc0c5340 tx=0x7efcac00c860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcaa7fc700 1 -- 172.21.15.57:0/17235193 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efcbc1b0e30 con 0x7efcbc0d7920 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcaa7fc700 1 -- 172.21.15.57:0/17235193 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac0072e0 con 0x7efcbc0d7920 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc4521700 1 -- 172.21.15.57:0/17235193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc1b79d0 con 0x7efcbc0d7920 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcaa7fc700 1 -- 172.21.15.57:0/17235193 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efcac005810 con 0x7efcbc0d7920 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.382 7efcc4521700 1 -- 172.21.15.57:0/17235193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc1b7db0 con 0x7efcbc0d7920 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.383 7efcaa7fc700 1 -- 172.21.15.57:0/17235193 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7efcac005a10 con 0x7efcbc0d7920 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.383 7efcaa7fc700 1 -- 172.21.15.57:0/17235193 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7efcac0148d0 con 0x7efcbc0d7920 2024-04-25T02:06:10.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.383 7efcc4521700 1 -- 172.21.15.57:0/17235193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc0f08e0 con 0x7efcbc0d7920 2024-04-25T02:06:10.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.387 7efcaa7fc700 1 -- 172.21.15.57:0/17235193 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7efcac0070d0 con 0x7efcbc0d7920 2024-04-25T02:06:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.496 7efcc4521700 1 -- 172.21.15.57:0/17235193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efcbc1aa8d0 con 0x7efcbc0d7920 2024-04-25T02:06:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.496 7efcaa7fc700 1 -- 172.21.15.57:0/17235193 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7efcac000c30 con 0x7efcbc0d7920 2024-04-25T02:06:10.503 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:10.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 -- 172.21.15.57:0/17235193 >> v1:172.21.15.57:6816/43033 conn(0x7efc9c0145b0 legacy=0x7efc9c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 -- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc0d7920 msgr2=0x7efcbc0ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc0d7920 0x7efcbc0ce3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7efcbc0c5340 tx=0x7efcac00c860).stop 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 -- 172.21.15.57:0/17235193 shutdown_connections 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0cee70 0x7efcbc1b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc0d7920 0x7efcbc0ce3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 --2- 172.21.15.57:0/17235193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0cea20 0x7efcbc1b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 -- 172.21.15.57:0/17235193 >> 172.21.15.57:0/17235193 conn(0x7efcbc0c5590 msgr2=0x7efcbc1a43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 -- 172.21.15.57:0/17235193 shutdown_connections 2024-04-25T02:06:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.497 7efcc4521700 1 -- 172.21.15.57:0/17235193 wait complete. 2024-04-25T02:06:10.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529f4b1700 1 Processor -- start 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529f4b1700 1 -- start start 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529f4b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980f5920 0x7f52980f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529f4b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980f1ec0 0x7f529810e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529f4b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52980f2310 0x7f529810e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529f4b1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52980f9230 con 0x7f52980f2310 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529f4b1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529810ef10 con 0x7f52980f5920 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529f4b1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52981aa660 con 0x7f52980f1ec0 2024-04-25T02:06:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f5297fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980f5920 0x7f52980f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f52977fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980f1ec0 0x7f529810e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f529caad700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52980f2310 0x7f529810e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f5297fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980f5920 0x7f52980f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36600/0 (socket says 172.21.15.57:36600) 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f5297fff700 1 -- 172.21.15.57:0/2264103073 learned_addr learned my addr 172.21.15.57:0/2264103073 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.643 7f52977fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980f1ec0 0x7f529810e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33184/0 (socket says 172.21.15.57:33184) 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f529caad700 1 -- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980f1ec0 msgr2=0x7f529810e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f529caad700 1 --2- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980f1ec0 0x7f529810e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f529caad700 1 -- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980f5920 msgr2=0x7f52980f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f529caad700 1 --2- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980f5920 0x7f52980f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f529caad700 1 -- 172.21.15.57:0/2264103073 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52981aa810 con 0x7f52980f2310 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f5297fff700 1 --2- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980f5920 0x7f52980f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f529caad700 1 --2- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980f2310 0x7f529810e8e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f52900032f0 tx=0x7f5290009d10).ready entity=mon.0 client_cookie=760b0f3547fc874b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f5296ffd700 1 -- 172.21.15.57:0/2264103073 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f52981aa810 con 0x7f52980f2310 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f5296ffd700 1 -- 172.21.15.57:0/2264103073 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529000b7a0 con 0x7f52980f2310 2024-04-25T02:06:10.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f5296ffd700 1 -- 172.21.15.57:0/2264103073 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f529000b980 con 0x7f52980f2310 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f529f4b1700 1 -- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980f2310 msgr2=0x7f529810e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.644 7f529f4b1700 1 --2- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980f2310 0x7f529810e8e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f52900032f0 tx=0x7f5290009d10).stop 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.645 7f529f4b1700 1 -- 172.21.15.57:0/2264103073 shutdown_connections 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.645 7f529f4b1700 1 --2- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980f2310 0x7f529810e8e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.645 7f529f4b1700 1 --2- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980f5920 0x7f52980f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.645 7f529f4b1700 1 --2- 172.21.15.57:0/2264103073 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980f1ec0 0x7f529810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.645 7f529f4b1700 1 -- 172.21.15.57:0/2264103073 >> 172.21.15.57:0/2264103073 conn(0x7f5298113a70 msgr2=0x7f52980f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.645 7f529f4b1700 1 -- 172.21.15.57:0/2264103073 shutdown_connections 2024-04-25T02:06:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.645 7f529f4b1700 1 -- 172.21.15.57:0/2264103073 wait complete. 2024-04-25T02:06:10.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529f4b1700 1 Processor -- start 2024-04-25T02:06:10.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529f4b1700 1 -- start start 2024-04-25T02:06:10.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529f4b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980dae30 0x7f52980c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529f4b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980c9ed0 0x7f52980c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529f4b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980c4e70 0x7f52981bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529f4b1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52980db790 con 0x7f52980c9ed0 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529f4b1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52980c52c0 con 0x7f52980dae30 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529f4b1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52980c54f0 con 0x7f52980c4e70 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f52977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980c9ed0 0x7f52980c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f5297fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980dae30 0x7f52980c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f5297fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980dae30 0x7f52980c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36614/0 (socket says 172.21.15.57:36614) 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f52977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980c9ed0 0x7f52980c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60126/0 (socket says 172.21.15.57:60126) 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f5297fff700 1 -- 172.21.15.57:0/1482008253 learned_addr learned my addr 172.21.15.57:0/1482008253 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.669 7f529caad700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980c4e70 0x7f52981bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f5297fff700 1 -- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980c4e70 msgr2=0x7f52981bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f5297fff700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980c4e70 0x7f52981bbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f5297fff700 1 -- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980c9ed0 msgr2=0x7f52980c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f5297fff700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980c9ed0 0x7f52980c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f5297fff700 1 -- 172.21.15.57:0/1482008253 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52981bc370 con 0x7f52980dae30 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f529caad700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980c4e70 0x7f52981bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f5297fff700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980dae30 0x7f52980c98a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f52980cfb80 tx=0x7f528800eac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f52957fa700 1 -- 172.21.15.57:0/1482008253 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f52981bc370 con 0x7f52980dae30 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f52957fa700 1 -- 172.21.15.57:0/1482008253 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5288012600 con 0x7f52980dae30 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52981bc570 con 0x7f52980dae30 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f52957fa700 1 -- 172.21.15.57:0/1482008253 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f528800f040 con 0x7f52980dae30 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.670 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52981bc950 con 0x7f52980dae30 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.671 7f52957fa700 1 -- 172.21.15.57:0/1482008253 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5288022060 con 0x7f52980dae30 2024-04-25T02:06:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.671 7f52957fa700 1 -- 172.21.15.57:0/1482008253 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5288010040 con 0x7f52980dae30 2024-04-25T02:06:10.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.671 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52980f08e0 con 0x7f52980dae30 2024-04-25T02:06:10.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.674 7f52957fa700 1 -- 172.21.15.57:0/1482008253 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f52880123f0 con 0x7f52980dae30 2024-04-25T02:06:10.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.785 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52980d8500 con 0x7f52980dae30 2024-04-25T02:06:10.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.786 7f52957fa700 1 -- 172.21.15.57:0/1482008253 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5288000c30 con 0x7f52980dae30 2024-04-25T02:06:10.792 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 >> v1:172.21.15.57:6816/43033 conn(0x7f52780145b0 legacy=0x7f5278016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980dae30 msgr2=0x7f52980c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980dae30 0x7f52980c98a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f52980cfb80 tx=0x7f528800eac0).stop 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 shutdown_connections 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52980c4e70 0x7f52981bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52980dae30 0x7f52980c98a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 --2- 172.21.15.57:0/1482008253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52980c9ed0 0x7f52980c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 >> 172.21.15.57:0/1482008253 conn(0x7f52980dea50 msgr2=0x7f52980d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 shutdown_connections 2024-04-25T02:06:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.787 7f529f4b1700 1 -- 172.21.15.57:0/1482008253 wait complete. 2024-04-25T02:06:10.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7c3471700 1 Processor -- start 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7c3471700 1 -- start start 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7c3471700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff7bc0f5a10 0x7ff7bc10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7c3471700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc10b740 0x7ff7bc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7c3471700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc1a0a70 con 0x7ff7bc10bb90 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7c3471700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0fa590 con 0x7ff7bc0f5a10 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7c3471700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1a0c90 con 0x7ff7bc10b740 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7bbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff7bc0f5a10 0x7ff7bc10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7bb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc10b740 0x7ff7bc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.929 7ff7c0a6d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff7bc10bb90 0x7ff7bc1a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51974/0 (socket says 172.21.15.57:51974) 2024-04-25T02:06:10.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7c0a6d700 1 -- 172.21.15.57:0/3346628799 learned_addr learned my addr 172.21.15.57:0/3346628799 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7bb7fe700 1 -- 172.21.15.57:0/3346628799 >> v2:172.21.15.57:3300/0 conn(0x7ff7bc0f5a10 msgr2=0x7ff7bc10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7bb7fe700 1 --2- 172.21.15.57:0/3346628799 >> v2:172.21.15.57:3300/0 conn(0x7ff7bc0f5a10 0x7ff7bc10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7bb7fe700 1 -- 172.21.15.57:0/3346628799 >> v1:172.21.15.57:6789/0 conn(0x7ff7bc10bb90 legacy=0x7ff7bc1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7bb7fe700 1 -- 172.21.15.57:0/3346628799 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc1a93d0 con 0x7ff7bc10b740 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7baffd700 1 -- 172.21.15.57:0/3346628799 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069016513 0 0) 0x7ff7b4001490 con 0x7ff7bc10bb90 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7bbfff700 1 --2- 172.21.15.57:0/3346628799 >> v2:172.21.15.57:3300/0 conn(0x7ff7bc0f5a10 0x7ff7bc10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7bb7fe700 1 --2- 172.21.15.57:0/3346628799 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc10b740 0x7ff7bc19fc40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff7bc103a10 tx=0x7ff7b000b9a0).ready entity=mon.1 client_cookie=efb77ddc3075bd9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7baffd700 1 -- 172.21.15.57:0/3346628799 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7bc1a93d0 con 0x7ff7bc10b740 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7baffd700 1 -- 172.21.15.57:0/3346628799 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b000d5c0 con 0x7ff7bc10b740 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7baffd700 1 -- 172.21.15.57:0/3346628799 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7b000d990 con 0x7ff7bc10b740 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7c3471700 1 -- 172.21.15.57:0/3346628799 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc10b740 msgr2=0x7ff7bc19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.930 7ff7c3471700 1 --2- 172.21.15.57:0/3346628799 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc10b740 0x7ff7bc19fc40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff7bc103a10 tx=0x7ff7b000b9a0).stop 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.931 7ff7c3471700 1 -- 172.21.15.57:0/3346628799 shutdown_connections 2024-04-25T02:06:10.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.931 7ff7c3471700 1 --2- 172.21.15.57:0/3346628799 >> v2:172.21.15.57:3300/0 conn(0x7ff7bc0f5a10 0x7ff7bc10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.931 7ff7c3471700 1 --2- 172.21.15.57:0/3346628799 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc10b740 0x7ff7bc19fc40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.931 7ff7c3471700 1 -- 172.21.15.57:0/3346628799 >> 172.21.15.57:0/3346628799 conn(0x7ff7bc113a70 msgr2=0x7ff7bc0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:10.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.931 7ff7c3471700 1 -- 172.21.15.57:0/3346628799 shutdown_connections 2024-04-25T02:06:10.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.931 7ff7c3471700 1 -- 172.21.15.57:0/3346628799 wait complete. 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c3471700 1 Processor -- start 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c3471700 1 -- start start 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c3471700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc0d7440 0x7ff7bc0d7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c3471700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0d7ec0 0x7ff7bc1b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c3471700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7bc1b2740 0x7ff7bc1b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c3471700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1b31c0 con 0x7ff7bc0d7ec0 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c3471700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0dc420 con 0x7ff7bc0d7440 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c3471700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0cfcf0 con 0x7ff7bc1b2740 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7bbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc0d7440 0x7ff7bc0d7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7bb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0d7ec0 0x7ff7bc1b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7bbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc0d7440 0x7ff7bc0d7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36628/0 (socket says 172.21.15.57:36628) 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7bb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0d7ec0 0x7ff7bc1b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60142/0 (socket says 172.21.15.57:60142) 2024-04-25T02:06:10.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7bbfff700 1 -- 172.21.15.57:0/4012161380 learned_addr learned my addr 172.21.15.57:0/4012161380 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.955 7ff7c0a6d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7bc1b2740 0x7ff7bc1b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7bbfff700 1 -- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7bc1b2740 msgr2=0x7ff7bc1b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7bbfff700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7bc1b2740 0x7ff7bc1b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7bbfff700 1 -- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0d7ec0 msgr2=0x7ff7bc1b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7bbfff700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0d7ec0 0x7ff7bc1b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7bbfff700 1 -- 172.21.15.57:0/4012161380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc088f50 con 0x7ff7bc0d7440 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7c0a6d700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7bc1b2740 0x7ff7bc1b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7bb7fe700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0d7ec0 0x7ff7bc1b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7bbfff700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc0d7440 0x7ff7bc0d7890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff7bc0c6470 tx=0x7ff7ac00bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7b97fa700 1 -- 172.21.15.57:0/4012161380 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7bc088f50 con 0x7ff7bc0d7440 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7b97fa700 1 -- 172.21.15.57:0/4012161380 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac00c9a0 con 0x7ff7bc0d7440 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc0dc6e0 con 0x7ff7bc0d7440 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7b97fa700 1 -- 172.21.15.57:0/4012161380 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7ac00f040 con 0x7ff7bc0d7440 2024-04-25T02:06:10.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.956 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc1b9800 con 0x7ff7bc0d7440 2024-04-25T02:06:10.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.957 7ff7b97fa700 1 -- 172.21.15.57:0/4012161380 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff7ac011070 con 0x7ff7bc0d7440 2024-04-25T02:06:10.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.957 7ff7b97fa700 1 -- 172.21.15.57:0/4012161380 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ff7ac010040 con 0x7ff7bc0d7440 2024-04-25T02:06:10.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.957 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc0f08e0 con 0x7ff7bc0d7440 2024-04-25T02:06:10.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:10.960 7ff7b97fa700 1 -- 172.21.15.57:0/4012161380 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ff7ac00c5a0 con 0x7ff7bc0d7440 2024-04-25T02:06:11.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.071 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7bc0e2430 con 0x7ff7bc0d7440 2024-04-25T02:06:11.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.071 7ff7b97fa700 1 -- 172.21.15.57:0/4012161380 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7ff7ac000c30 con 0x7ff7bc0d7440 2024-04-25T02:06:11.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:11.078 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 >> v1:172.21.15.57:6816/43033 conn(0x7ff79c0145b0 legacy=0x7ff79c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc0d7440 msgr2=0x7ff7bc0d7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc0d7440 0x7ff7bc0d7890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff7bc0c6470 tx=0x7ff7ac00bf70).stop 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 shutdown_connections 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff7bc1b2740 0x7ff7bc1b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7bc0d7440 0x7ff7bc0d7890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 --2- 172.21.15.57:0/4012161380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7bc0d7ec0 0x7ff7bc1b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 >> 172.21.15.57:0/4012161380 conn(0x7ff7bc0c5560 msgr2=0x7ff7bc0c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 shutdown_connections 2024-04-25T02:06:11.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.073 7ff7c3471700 1 -- 172.21.15.57:0/4012161380 wait complete. 2024-04-25T02:06:11.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:11.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.218 7fee4b6e9700 1 Processor -- start 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.218 7fee4b6e9700 1 -- start start 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee4b6e9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee440f5990 0x7fee4410b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee4b6e9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fee4410bb10 0x7fee441a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee4b6e9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee441a09f0 con 0x7fee4410b6c0 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee4b6e9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee440fa510 con 0x7fee4410bb10 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee4b6e9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee441a0c10 con 0x7fee440f5990 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee48ce5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fee4410bb10 0x7fee441a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee43fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee440f5990 0x7fee4410b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee437fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fee4410b6c0 0x7fee4419fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51982/0 (socket says 172.21.15.57:51982) 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee43fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee440f5990 0x7fee4410b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33212/0 (socket says 172.21.15.57:33212) 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee48ce5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fee4410bb10 0x7fee441a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60152/0 (socket says 172.21.15.57:60152) 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee437fe700 1 -- 172.21.15.57:0/347756132 learned_addr learned my addr 172.21.15.57:0/347756132 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee42ffd700 1 -- 172.21.15.57:0/347756132 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953967477 0 0) 0x7fee2c001110 con 0x7fee4410b6c0 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee42ffd700 1 -- 172.21.15.57:0/347756132 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee24003270 con 0x7fee4410b6c0 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee48ce5700 1 -- 172.21.15.57:0/347756132 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee440f5990 msgr2=0x7fee4410b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee48ce5700 1 --2- 172.21.15.57:0/347756132 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee440f5990 0x7fee4410b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee48ce5700 1 -- 172.21.15.57:0/347756132 >> v1:172.21.15.57:6789/0 conn(0x7fee4410b6c0 legacy=0x7fee4419fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee48ce5700 1 -- 172.21.15.57:0/347756132 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee441a9350 con 0x7fee4410bb10 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee43fff700 1 --2- 172.21.15.57:0/347756132 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee440f5990 0x7fee4410b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.219 7fee48ce5700 1 --2- 172.21.15.57:0/347756132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee4410bb10 0x7fee441a03c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fee3c0032f0 tx=0x7fee3c009d10).ready entity=mon.0 client_cookie=520ad0f7401068cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee42ffd700 1 -- 172.21.15.57:0/347756132 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fee441a9350 con 0x7fee4410bb10 2024-04-25T02:06:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee42ffd700 1 -- 172.21.15.57:0/347756132 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c00b800 con 0x7fee4410bb10 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee42ffd700 1 -- 172.21.15.57:0/347756132 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fee3c00b9e0 con 0x7fee4410bb10 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee4b6e9700 1 -- 172.21.15.57:0/347756132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee4410bb10 msgr2=0x7fee441a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee4b6e9700 1 --2- 172.21.15.57:0/347756132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee4410bb10 0x7fee441a03c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fee3c0032f0 tx=0x7fee3c009d10).stop 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee4b6e9700 1 -- 172.21.15.57:0/347756132 shutdown_connections 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee4b6e9700 1 --2- 172.21.15.57:0/347756132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee4410bb10 0x7fee441a03c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee4b6e9700 1 --2- 172.21.15.57:0/347756132 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee440f5990 0x7fee4410b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee4b6e9700 1 -- 172.21.15.57:0/347756132 >> 172.21.15.57:0/347756132 conn(0x7fee441139f0 msgr2=0x7fee440f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee4b6e9700 1 -- 172.21.15.57:0/347756132 shutdown_connections 2024-04-25T02:06:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.220 7fee4b6e9700 1 -- 172.21.15.57:0/347756132 wait complete. 2024-04-25T02:06:11.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.244 7fee4b6e9700 1 Processor -- start 2024-04-25T02:06:11.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.244 7fee4b6e9700 1 -- start start 2024-04-25T02:06:11.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee4b6e9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee441a1890 0x7fee440d5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee4b6e9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee440d56c0 0x7fee441afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee4b6e9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee440d5b10 0x7fee441b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee4b6e9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee441a11d0 con 0x7fee440d56c0 2024-04-25T02:06:11.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee4b6e9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee441b08c0 con 0x7fee440d5b10 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee4b6e9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee441b0af0 con 0x7fee441a1890 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee441a1890 0x7fee440d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee440d56c0 0x7fee441afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee48ce5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee440d5b10 0x7fee441b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee441a1890 0x7fee440d5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33216/0 (socket says 172.21.15.57:33216) 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 -- 172.21.15.57:0/1259894288 learned_addr learned my addr 172.21.15.57:0/1259894288 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee440d56c0 0x7fee441afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60158/0 (socket says 172.21.15.57:60158) 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 -- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee440d5b10 msgr2=0x7fee441b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee440d5b10 0x7fee441b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 -- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee440d56c0 msgr2=0x7fee441afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee440d56c0 0x7fee441afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 -- 172.21.15.57:0/1259894288 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee441b73d0 con 0x7fee441a1890 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee48ce5700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee440d5b10 0x7fee441b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee437fe700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee440d56c0 0x7fee441afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee43fff700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee441a1890 0x7fee440d5090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fee3400e000 tx=0x7fee3400e360).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee417fa700 1 -- 172.21.15.57:0/1259894288 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fee441b73d0 con 0x7fee441a1890 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee417fa700 1 -- 172.21.15.57:0/1259894288 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3401a470 con 0x7fee441a1890 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee417fa700 1 -- 172.21.15.57:0/1259894288 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fee3401a840 con 0x7fee441a1890 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.245 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee441b75d0 con 0x7fee441a1890 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.246 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee441b79b0 con 0x7fee441a1890 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.246 7fee417fa700 1 -- 172.21.15.57:0/1259894288 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fee34022070 con 0x7fee441a1890 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.246 7fee417fa700 1 -- 172.21.15.57:0/1259894288 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fee34012d30 con 0x7fee441a1890 2024-04-25T02:06:11.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.246 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee440f0860 con 0x7fee441a1890 2024-04-25T02:06:11.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.250 7fee417fa700 1 -- 172.21.15.57:0/1259894288 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fee3400eaa0 con 0x7fee441a1890 2024-04-25T02:06:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.360 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee441aa420 con 0x7fee441a1890 2024-04-25T02:06:11.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.361 7fee417fa700 1 -- 172.21.15.57:0/1259894288 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee34000c30 con 0x7fee441a1890 2024-04-25T02:06:11.367 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 >> v1:172.21.15.57:6816/43033 conn(0x7fee280145b0 legacy=0x7fee28016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee441a1890 msgr2=0x7fee440d5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee441a1890 0x7fee440d5090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fee3400e000 tx=0x7fee3400e360).stop 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 shutdown_connections 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee440d5b10 0x7fee441b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee441a1890 0x7fee440d5090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 --2- 172.21.15.57:0/1259894288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee440d56c0 0x7fee441afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 >> 172.21.15.57:0/1259894288 conn(0x7fee440e0130 msgr2=0x7fee440c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:11.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 shutdown_connections 2024-04-25T02:06:11.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.362 7fee4b6e9700 1 -- 172.21.15.57:0/1259894288 wait complete. 2024-04-25T02:06:11.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:11.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.506 7f2e7eea7700 1 Processor -- start 2024-04-25T02:06:11.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.506 7f2e7eea7700 1 -- start start 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e7eea7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e780f58a0 0x7f2e7810c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e7eea7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e7810c8f0 0x7f2e780f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e7eea7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e7810cd40 0x7f2e780f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e7eea7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e780fa210 con 0x7f2e7810cd40 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e7eea7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780f9540 con 0x7f2e7810c8f0 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e7eea7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780f2470 con 0x7f2e780f58a0 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e780f58a0 0x7f2e7810c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e76ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e7810c8f0 0x7f2e780f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e77fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e7810cd40 0x7f2e780f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e780f58a0 0x7f2e7810c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33230/0 (socket says 172.21.15.57:33230) 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e76ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e7810c8f0 0x7f2e780f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36632/0 (socket says 172.21.15.57:36632) 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e77fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e7810cd40 0x7f2e780f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60172/0 (socket says 172.21.15.57:60172) 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 -- 172.21.15.57:0/4215558568 learned_addr learned my addr 172.21.15.57:0/4215558568 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:11.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 -- 172.21.15.57:0/4215558568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e7810c8f0 msgr2=0x7f2e780f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 --2- 172.21.15.57:0/4215558568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e7810c8f0 0x7f2e780f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 -- 172.21.15.57:0/4215558568 >> v2:172.21.15.57:3300/0 conn(0x7f2e7810cd40 msgr2=0x7f2e780f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 --2- 172.21.15.57:0/4215558568 >> v2:172.21.15.57:3300/0 conn(0x7f2e7810cd40 0x7f2e780f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 -- 172.21.15.57:0/4215558568 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e780f26a0 con 0x7f2e780f58a0 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e76ffd700 1 --2- 172.21.15.57:0/4215558568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e7810c8f0 0x7f2e780f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e77fff700 1 --2- 172.21.15.57:0/4215558568 >> v2:172.21.15.57:3300/0 conn(0x7f2e7810cd40 0x7f2e780f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.507 7f2e777fe700 1 --2- 172.21.15.57:0/4215558568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e780f58a0 0x7f2e7810c2c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2e68002f70 tx=0x7f2e680099d0).ready entity=mon.2 client_cookie=a59abe6e0e3320b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e767fc700 1 -- 172.21.15.57:0/4215558568 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2e780f26a0 con 0x7f2e780f58a0 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e767fc700 1 -- 172.21.15.57:0/4215558568 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800f510 con 0x7f2e780f58a0 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e767fc700 1 -- 172.21.15.57:0/4215558568 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2e6800f6f0 con 0x7f2e780f58a0 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 -- 172.21.15.57:0/4215558568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e780f58a0 msgr2=0x7f2e7810c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 --2- 172.21.15.57:0/4215558568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e780f58a0 0x7f2e7810c2c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2e68002f70 tx=0x7f2e680099d0).stop 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 -- 172.21.15.57:0/4215558568 shutdown_connections 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 --2- 172.21.15.57:0/4215558568 >> v2:172.21.15.57:3300/0 conn(0x7f2e7810cd40 0x7f2e780f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 --2- 172.21.15.57:0/4215558568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e780f58a0 0x7f2e7810c2c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 --2- 172.21.15.57:0/4215558568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e7810c8f0 0x7f2e780f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 -- 172.21.15.57:0/4215558568 >> 172.21.15.57:0/4215558568 conn(0x7f2e781139f0 msgr2=0x7f2e780f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:11.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 -- 172.21.15.57:0/4215558568 shutdown_connections 2024-04-25T02:06:11.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.508 7f2e7eea7700 1 -- 172.21.15.57:0/4215558568 wait complete. 2024-04-25T02:06:11.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.532 7f2e7eea7700 1 Processor -- start 2024-04-25T02:06:11.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.532 7f2e7eea7700 1 -- start start 2024-04-25T02:06:11.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.532 7f2e7eea7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e780e05c0 0x7f2e780d53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e7eea7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e780c4010 0x7f2e780d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e7eea7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e781b21d0 0x7f2e781b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e7eea7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780d6020 con 0x7f2e780e05c0 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e7eea7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780d6200 con 0x7f2e780c4010 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e7eea7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781b2c50 con 0x7f2e781b21d0 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e780e05c0 0x7f2e780d53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e76ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e780c4010 0x7f2e780d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e780e05c0 0x7f2e780d53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60176/0 (socket says 172.21.15.57:60176) 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 -- 172.21.15.57:0/4114552340 learned_addr learned my addr 172.21.15.57:0/4114552340 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e77fff700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e781b21d0 0x7f2e781b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 -- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e781b21d0 msgr2=0x7f2e781b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e781b21d0 0x7f2e781b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 -- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e780c4010 msgr2=0x7f2e780d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e780c4010 0x7f2e780d59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 -- 172.21.15.57:0/4114552340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e781b2e80 con 0x7f2e780e05c0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e76ffd700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e780c4010 0x7f2e780d59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e777fe700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e780e05c0 0x7f2e780d53c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2e780d7660 tx=0x7f2e680068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e74ff9700 1 -- 172.21.15.57:0/4114552340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2e781b2e80 con 0x7f2e780e05c0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e74ff9700 1 -- 172.21.15.57:0/4114552340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011610 con 0x7f2e780e05c0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e74ff9700 1 -- 172.21.15.57:0/4114552340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2e680119e0 con 0x7f2e780e05c0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e781b3140 con 0x7f2e780e05c0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.533 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e781b9bb0 con 0x7f2e780e05c0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.534 7f2e74ff9700 1 -- 172.21.15.57:0/4114552340 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f2e68011be0 con 0x7f2e780e05c0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.534 7f2e74ff9700 1 -- 172.21.15.57:0/4114552340 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f2e68001b90 con 0x7f2e780e05c0 2024-04-25T02:06:11.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.534 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e780f0860 con 0x7f2e780e05c0 2024-04-25T02:06:11.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.538 7f2e74ff9700 1 -- 172.21.15.57:0/4114552340 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f2e68011400 con 0x7f2e780e05c0 2024-04-25T02:06:11.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.647 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e781ac8b0 con 0x7f2e780e05c0 2024-04-25T02:06:11.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.648 7f2e74ff9700 1 -- 172.21.15.57:0/4114552340 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e6800f300 con 0x7f2e780e05c0 2024-04-25T02:06:11.655 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:11.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 >> v1:172.21.15.57:6816/43033 conn(0x7f2e5c0145b0 legacy=0x7f2e5c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e780e05c0 msgr2=0x7f2e780d53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e780e05c0 0x7f2e780d53c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2e780d7660 tx=0x7f2e680068c0).stop 2024-04-25T02:06:11.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 shutdown_connections 2024-04-25T02:06:11.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2e781b21d0 0x7f2e781b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e780e05c0 0x7f2e780d53c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 --2- 172.21.15.57:0/4114552340 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e780c4010 0x7f2e780d59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 >> 172.21.15.57:0/4114552340 conn(0x7f2e780c9050 msgr2=0x7f2e780c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:11.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 shutdown_connections 2024-04-25T02:06:11.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.649 7f2e7eea7700 1 -- 172.21.15.57:0/4114552340 wait complete. 2024-04-25T02:06:11.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:11.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.794 7f6109249700 1 Processor -- start 2024-04-25T02:06:11.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.794 7f6109249700 1 -- start start 2024-04-25T02:06:11.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6109249700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f610410cb40 0x7f61041a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6109249700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f61041a6be0 0x7f61041a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6109249700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610410cf90 con 0x7f61040f5920 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6109249700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61040fa290 con 0x7f61041a6be0 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6109249700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61040f95c0 con 0x7f610410cb40 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6102838700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f61041a6be0 0x7f61041a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6102037700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f61040f5920 0x7f610410c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51984/0 (socket says 172.21.15.57:51984) 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6102037700 1 -- 172.21.15.57:0/2360503238 learned_addr learned my addr 172.21.15.57:0/2360503238 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f60f9836700 1 --2- 172.21.15.57:0/2360503238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f610410cb40 0x7f61041a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f60f9836700 1 -- 172.21.15.57:0/2360503238 >> v2:172.21.15.57:3300/0 conn(0x7f61041a6be0 msgr2=0x7f61041a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f60f9836700 1 --2- 172.21.15.57:0/2360503238 >> v2:172.21.15.57:3300/0 conn(0x7f61041a6be0 0x7f61041a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f60f9836700 1 -- 172.21.15.57:0/2360503238 >> v1:172.21.15.57:6789/0 conn(0x7f61040f5920 legacy=0x7f610410c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6101836700 1 -- 172.21.15.57:0/2360503238 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450661712 0 0) 0x7f60f4001110 con 0x7f61040f5920 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f60f9836700 1 -- 172.21.15.57:0/2360503238 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61041aa680 con 0x7f610410cb40 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.795 7f6102838700 1 --2- 172.21.15.57:0/2360503238 >> v2:172.21.15.57:3300/0 conn(0x7f61041a6be0 0x7f61041a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f60f9836700 1 --2- 172.21.15.57:0/2360503238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f610410cb40 0x7f61041a65b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f60ec002f70 tx=0x7f60ec00b970).ready entity=mon.1 client_cookie=56e39b341637d8c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6101836700 1 -- 172.21.15.57:0/2360503238 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61041aa680 con 0x7f610410cb40 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6101836700 1 -- 172.21.15.57:0/2360503238 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00d610 con 0x7f610410cb40 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6101836700 1 -- 172.21.15.57:0/2360503238 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60ec00d9e0 con 0x7f610410cb40 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6109249700 1 -- 172.21.15.57:0/2360503238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f610410cb40 msgr2=0x7f61041a65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6109249700 1 --2- 172.21.15.57:0/2360503238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f610410cb40 0x7f61041a65b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f60ec002f70 tx=0x7f60ec00b970).stop 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6109249700 1 -- 172.21.15.57:0/2360503238 shutdown_connections 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6109249700 1 --2- 172.21.15.57:0/2360503238 >> v2:172.21.15.57:3300/0 conn(0x7f61041a6be0 0x7f61041a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6109249700 1 --2- 172.21.15.57:0/2360503238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f610410cb40 0x7f61041a65b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6109249700 1 -- 172.21.15.57:0/2360503238 >> 172.21.15.57:0/2360503238 conn(0x7f6104113a70 msgr2=0x7f61040f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:11.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.796 7f6109249700 1 -- 172.21.15.57:0/2360503238 shutdown_connections 2024-04-25T02:06:11.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.797 7f6109249700 1 -- 172.21.15.57:0/2360503238 wait complete. 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.820 7f6109249700 1 Processor -- start 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.820 7f6109249700 1 -- start start 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6109249700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f61040dd7b0 0x7f61040d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6109249700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61040d58d0 0x7f61041b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6109249700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61040d5d20 0x7f61041b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6109249700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61040dcf70 con 0x7f61040d58d0 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6109249700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61040c4770 con 0x7f61040d5d20 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6109249700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61041b2e00 con 0x7f61040dd7b0 2024-04-25T02:06:11.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f60f9836700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61040d58d0 0x7f61041b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6102037700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f61040dd7b0 0x7f61040d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6102838700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61040d5d20 0x7f61041b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f60f9836700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61040d58d0 0x7f61041b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60202/0 (socket says 172.21.15.57:60202) 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f60f9836700 1 -- 172.21.15.57:0/3059290676 learned_addr learned my addr 172.21.15.57:0/3059290676 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6102037700 1 -- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61040d5d20 msgr2=0x7f61041b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6102037700 1 --2- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61040d5d20 0x7f61041b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6102037700 1 -- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61040d58d0 msgr2=0x7f61041b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6102037700 1 --2- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61040d58d0 0x7f61041b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6102037700 1 -- 172.21.15.57:0/3059290676 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61041b3030 con 0x7f61040dd7b0 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f60f9836700 1 --2- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61040d58d0 0x7f61041b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f6102037700 1 --2- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f61040dd7b0 0x7f61040d52a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f61040c5230 tx=0x7f60f400c7b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:11.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.821 7f60fbfff700 1 -- 172.21.15.57:0/3059290676 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61041b3030 con 0x7f61040dd7b0 2024-04-25T02:06:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.822 7f60fbfff700 1 -- 172.21.15.57:0/3059290676 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f40070d0 con 0x7f61040dd7b0 2024-04-25T02:06:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.822 7f6109249700 1 -- 172.21.15.57:0/3059290676 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61041b99a0 con 0x7f61040dd7b0 2024-04-25T02:06:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.822 7f60fbfff700 1 -- 172.21.15.57:0/3059290676 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60f4005620 con 0x7f61040dd7b0 2024-04-25T02:06:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.822 7f6109249700 1 -- 172.21.15.57:0/3059290676 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61041b9d80 con 0x7f61040dd7b0 2024-04-25T02:06:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.822 7f60fbfff700 1 -- 172.21.15.57:0/3059290676 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f60f4005a30 con 0x7f61040dd7b0 2024-04-25T02:06:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.822 7f60fbfff700 1 -- 172.21.15.57:0/3059290676 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f60f4014730 con 0x7f61040dd7b0 2024-04-25T02:06:11.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.823 7f6109249700 1 -- 172.21.15.57:0/3059290676 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61040f08e0 con 0x7f61040dd7b0 2024-04-25T02:06:11.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.826 7f60fbfff700 1 -- 172.21.15.57:0/3059290676 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f60f4005820 con 0x7f61040dd7b0 2024-04-25T02:06:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.939 7f6109249700 1 -- 172.21.15.57:0/3059290676 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61041ac8e0 con 0x7f61040dd7b0 2024-04-25T02:06:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.939 7f60fbfff700 1 -- 172.21.15.57:0/3059290676 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60f4000c30 con 0x7f61040dd7b0 2024-04-25T02:06:11.946 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 -- 172.21.15.57:0/3059290676 >> v1:172.21.15.57:6816/43033 conn(0x7f60e80145b0 legacy=0x7f60e8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 -- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f61040dd7b0 msgr2=0x7f61040d52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 --2- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f61040dd7b0 0x7f61040d52a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f61040c5230 tx=0x7f60f400c7b0).stop 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 -- 172.21.15.57:0/3059290676 shutdown_connections 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 --2- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61040d5d20 0x7f61041b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 --2- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f61040dd7b0 0x7f61040d52a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 --2- 172.21.15.57:0/3059290676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61040d58d0 0x7f61041b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 -- 172.21.15.57:0/3059290676 >> 172.21.15.57:0/3059290676 conn(0x7f61040c8e80 msgr2=0x7f61040d62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 -- 172.21.15.57:0/3059290676 shutdown_connections 2024-04-25T02:06:11.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:11.941 7f6109249700 1 -- 172.21.15.57:0/3059290676 wait complete. 2024-04-25T02:06:11.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.083 7fad0ec05700 1 Processor -- start 2024-04-25T02:06:12.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.083 7fad0ec05700 1 -- start start 2024-04-25T02:06:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.083 7fad0ec05700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fad080f5920 0x7fad0810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad0ec05700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad0810cdc0 0x7fad080f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad0ec05700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080f26c0 con 0x7fad0810c970 2024-04-25T02:06:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad0ec05700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080fa290 con 0x7fad080f5920 2024-04-25T02:06:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad0ec05700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad080f95c0 con 0x7fad0810cdc0 2024-04-25T02:06:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad077fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fad080f5920 0x7fad0810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad07fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad0810cdc0 0x7fad080f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7facfeffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fad0810c970 0x7fad080f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52000/0 (socket says 172.21.15.57:52000) 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7facfeffd700 1 -- 172.21.15.57:0/2006099147 learned_addr learned my addr 172.21.15.57:0/2006099147 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad07fff700 1 -- 172.21.15.57:0/2006099147 >> v2:172.21.15.57:3300/0 conn(0x7fad080f5920 msgr2=0x7fad0810c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad07fff700 1 --2- 172.21.15.57:0/2006099147 >> v2:172.21.15.57:3300/0 conn(0x7fad080f5920 0x7fad0810c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad07fff700 1 -- 172.21.15.57:0/2006099147 >> v1:172.21.15.57:6789/0 conn(0x7fad0810c970 legacy=0x7fad080f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad06ffd700 1 -- 172.21.15.57:0/2006099147 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260087765 0 0) 0x7facf0001110 con 0x7fad0810c970 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad07fff700 1 -- 172.21.15.57:0/2006099147 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad081aa5e0 con 0x7fad0810cdc0 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad07fff700 1 --2- 172.21.15.57:0/2006099147 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad0810cdc0 0x7fad080f2090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fad080f4640 tx=0x7fad00009cc0).ready entity=mon.2 client_cookie=6137399ddc73ebfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.084 7fad06ffd700 1 -- 172.21.15.57:0/2006099147 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad081aa5e0 con 0x7fad0810cdc0 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad06ffd700 1 -- 172.21.15.57:0/2006099147 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000b840 con 0x7fad0810cdc0 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad06ffd700 1 -- 172.21.15.57:0/2006099147 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad0000ba20 con 0x7fad0810cdc0 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad0ec05700 1 -- 172.21.15.57:0/2006099147 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad0810cdc0 msgr2=0x7fad080f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad0ec05700 1 --2- 172.21.15.57:0/2006099147 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad0810cdc0 0x7fad080f2090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fad080f4640 tx=0x7fad00009cc0).stop 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad0ec05700 1 -- 172.21.15.57:0/2006099147 shutdown_connections 2024-04-25T02:06:12.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad0ec05700 1 --2- 172.21.15.57:0/2006099147 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad0810cdc0 0x7fad080f2090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad0ec05700 1 --2- 172.21.15.57:0/2006099147 >> v2:172.21.15.57:3300/0 conn(0x7fad080f5920 0x7fad0810c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad0ec05700 1 -- 172.21.15.57:0/2006099147 >> 172.21.15.57:0/2006099147 conn(0x7fad08113a70 msgr2=0x7fad080f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad0ec05700 1 -- 172.21.15.57:0/2006099147 shutdown_connections 2024-04-25T02:06:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.085 7fad0ec05700 1 -- 172.21.15.57:0/2006099147 wait complete. 2024-04-25T02:06:12.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.109 7fad0ec05700 1 Processor -- start 2024-04-25T02:06:12.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.109 7fad0ec05700 1 -- start start 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad0ec05700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad080d5330 0x7fad080d5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad0ec05700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad080d5db0 0x7fad081b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad0ec05700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad081b28b0 0x7fad081b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad0ec05700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080dadf0 con 0x7fad080d5330 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad0ec05700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080cbe70 con 0x7fad081b28b0 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad0ec05700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad081b3330 con 0x7fad080d5db0 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad080d5330 0x7fad080d5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad080d5330 0x7fad080d5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60214/0 (socket says 172.21.15.57:60214) 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7facfeffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad080d5db0 0x7fad081b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad077fe700 1 -- 172.21.15.57:0/3127948847 learned_addr learned my addr 172.21.15.57:0/3127948847 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.110 7fad07fff700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad081b28b0 0x7fad081b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad077fe700 1 -- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad080d5db0 msgr2=0x7fad081b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad077fe700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad080d5db0 0x7fad081b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad077fe700 1 -- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad081b28b0 msgr2=0x7fad081b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad077fe700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad081b28b0 0x7fad081b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad077fe700 1 -- 172.21.15.57:0/3127948847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080f0200 con 0x7fad080d5330 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad07fff700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad081b28b0 0x7fad081b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7facfeffd700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad080d5db0 0x7fad081b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad077fe700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad080d5330 0x7fad080d5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fad080c6120 tx=0x7facf800ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad057fa700 1 -- 172.21.15.57:0/3127948847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad080f0200 con 0x7fad080d5330 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad057fa700 1 -- 172.21.15.57:0/3127948847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800c9a0 con 0x7fad080d5330 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad080cb470 con 0x7fad080d5330 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad057fa700 1 -- 172.21.15.57:0/3127948847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facf800f040 con 0x7fad080d5330 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad080cc2a0 con 0x7fad080d5330 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad057fa700 1 -- 172.21.15.57:0/3127948847 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7facf8011070 con 0x7fad080d5330 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.111 7fad057fa700 1 -- 172.21.15.57:0/3127948847 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7facf8010040 con 0x7fad080d5330 2024-04-25T02:06:12.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.112 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad080f08e0 con 0x7fad080d5330 2024-04-25T02:06:12.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.115 7fad057fa700 1 -- 172.21.15.57:0/3127948847 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7facf800c5a0 con 0x7fad080d5330 2024-04-25T02:06:12.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.226 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad081ac9a0 con 0x7fad080d5330 2024-04-25T02:06:12.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.227 7fad057fa700 1 -- 172.21.15.57:0/3127948847 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7facf8000c30 con 0x7fad080d5330 2024-04-25T02:06:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:12.234 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 >> v1:172.21.15.57:6816/43033 conn(0x7facec0145b0 legacy=0x7facec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad080d5330 msgr2=0x7fad080d5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad080d5330 0x7fad080d5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fad080c6120 tx=0x7facf800ed00).stop 2024-04-25T02:06:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 shutdown_connections 2024-04-25T02:06:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad081b28b0 0x7fad081b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad080d5330 0x7fad080d5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 --2- 172.21.15.57:0/3127948847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad080d5db0 0x7fad081b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 >> 172.21.15.57:0/3127948847 conn(0x7fad080c6c70 msgr2=0x7fad080d6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 shutdown_connections 2024-04-25T02:06:12.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.228 7fad0ec05700 1 -- 172.21.15.57:0/3127948847 wait complete. 2024-04-25T02:06:12.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:12.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.373 7f835a2e5700 1 Processor -- start 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.373 7f835a2e5700 1 -- start start 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f835a2e5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540f5920 0x7f835410c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f835a2e5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f835410cdc0 0x7f83540f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f835a2e5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83540f26c0 con 0x7f835410c970 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f835a2e5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83540fa290 con 0x7f835410cdc0 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f835a2e5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83540f95c0 con 0x7f83540f5920 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540f5920 0x7f835410c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540f5920 0x7f835410c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33274/0 (socket says 172.21.15.57:33274) 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353887700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f835410cdc0 0x7f83540f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353086700 1 -- 172.21.15.57:0/3745425328 learned_addr learned my addr 172.21.15.57:0/3745425328 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353887700 1 -- 172.21.15.57:0/3745425328 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540f5920 msgr2=0x7f835410c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353887700 1 --2- 172.21.15.57:0/3745425328 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540f5920 0x7f835410c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353887700 1 -- 172.21.15.57:0/3745425328 >> v1:172.21.15.57:6789/0 conn(0x7f835410c970 legacy=0x7f83540f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353887700 1 -- 172.21.15.57:0/3745425328 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83541aa5e0 con 0x7f835410cdc0 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8352885700 1 -- 172.21.15.57:0/3745425328 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956923959 0 0) 0x7f833c001110 con 0x7f835410c970 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.374 7f8353086700 1 --2- 172.21.15.57:0/3745425328 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540f5920 0x7f835410c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f8353887700 1 --2- 172.21.15.57:0/3745425328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f835410cdc0 0x7f83540f2090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8354113400 tx=0x7f834c009d40).ready entity=mon.0 client_cookie=7db6c916dfbeaed8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f8352885700 1 -- 172.21.15.57:0/3745425328 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83541aa5e0 con 0x7f835410cdc0 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f8352885700 1 -- 172.21.15.57:0/3745425328 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c00b7c0 con 0x7f835410cdc0 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f8352885700 1 -- 172.21.15.57:0/3745425328 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f834c00b9a0 con 0x7f835410cdc0 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f835a2e5700 1 -- 172.21.15.57:0/3745425328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f835410cdc0 msgr2=0x7f83540f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f835a2e5700 1 --2- 172.21.15.57:0/3745425328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f835410cdc0 0x7f83540f2090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8354113400 tx=0x7f834c009d40).stop 2024-04-25T02:06:12.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f835a2e5700 1 -- 172.21.15.57:0/3745425328 shutdown_connections 2024-04-25T02:06:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f835a2e5700 1 --2- 172.21.15.57:0/3745425328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f835410cdc0 0x7f83540f2090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f835a2e5700 1 --2- 172.21.15.57:0/3745425328 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540f5920 0x7f835410c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f835a2e5700 1 -- 172.21.15.57:0/3745425328 >> 172.21.15.57:0/3745425328 conn(0x7f8354113a70 msgr2=0x7f83540f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f835a2e5700 1 -- 172.21.15.57:0/3745425328 shutdown_connections 2024-04-25T02:06:12.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.375 7f835a2e5700 1 -- 172.21.15.57:0/3745425328 wait complete. 2024-04-25T02:06:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.399 7f835a2e5700 1 Processor -- start 2024-04-25T02:06:12.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.399 7f835a2e5700 1 -- start start 2024-04-25T02:06:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f835a2e5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540dfa30 0x7f83541aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f835a2e5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83541ac0b0 0x7f83541b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f835a2e5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83541ac500 0x7f83541b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f835a2e5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83540c4bf0 con 0x7f83541ac0b0 2024-04-25T02:06:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f835a2e5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83541b3150 con 0x7f83541ac500 2024-04-25T02:06:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f835a2e5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83541b3350 con 0x7f83540dfa30 2024-04-25T02:06:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540dfa30 0x7f83541aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540dfa30 0x7f83541aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33288/0 (socket says 172.21.15.57:33288) 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f834a885700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83541ac0b0 0x7f83541b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353887700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83541ac500 0x7f83541b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 -- 172.21.15.57:0/3122574464 learned_addr learned my addr 172.21.15.57:0/3122574464 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 -- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83541ac500 msgr2=0x7f83541b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 --2- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83541ac500 0x7f83541b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 -- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83541ac0b0 msgr2=0x7f83541b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 --2- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83541ac0b0 0x7f83541b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 -- 172.21.15.57:0/3122574464 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83541b9c60 con 0x7f83540dfa30 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f834a885700 1 --2- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83541ac0b0 0x7f83541b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.400 7f8353086700 1 --2- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540dfa30 0x7f83541aba80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f834400c000 tx=0x7f834400ec50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.401 7f8351082700 1 -- 172.21.15.57:0/3122574464 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83541b9c60 con 0x7f83540dfa30 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.401 7f8351082700 1 -- 172.21.15.57:0/3122574464 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834400c620 con 0x7f83540dfa30 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.401 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83541b9e60 con 0x7f83540dfa30 2024-04-25T02:06:12.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.401 7f8351082700 1 -- 172.21.15.57:0/3122574464 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f834400f040 con 0x7f83540dfa30 2024-04-25T02:06:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.401 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83541ba240 con 0x7f83540dfa30 2024-04-25T02:06:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.401 7f8351082700 1 -- 172.21.15.57:0/3122574464 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8344022060 con 0x7f83540dfa30 2024-04-25T02:06:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.401 7f8351082700 1 -- 172.21.15.57:0/3122574464 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8344010040 con 0x7f83540dfa30 2024-04-25T02:06:12.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.402 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83540f08e0 con 0x7f83540dfa30 2024-04-25T02:06:12.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.405 7f8351082700 1 -- 172.21.15.57:0/3122574464 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f834400ed90 con 0x7f83540dfa30 2024-04-25T02:06:12.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.515 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83540a61a0 con 0x7f83540dfa30 2024-04-25T02:06:12.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.516 7f8351082700 1 -- 172.21.15.57:0/3122574464 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8344000c30 con 0x7f83540dfa30 2024-04-25T02:06:12.523 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:12.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 >> v1:172.21.15.57:6816/43033 conn(0x7f83380145b0 legacy=0x7f8338016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540dfa30 msgr2=0x7f83541aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 --2- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540dfa30 0x7f83541aba80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f834400c000 tx=0x7f834400ec50).stop 2024-04-25T02:06:12.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 shutdown_connections 2024-04-25T02:06:12.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 --2- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83541ac500 0x7f83541b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 --2- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f83540dfa30 0x7f83541aba80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 --2- 172.21.15.57:0/3122574464 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83541ac0b0 0x7f83541b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 >> 172.21.15.57:0/3122574464 conn(0x7f83540c5c90 msgr2=0x7f83540cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:12.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 shutdown_connections 2024-04-25T02:06:12.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.517 7f835a2e5700 1 -- 172.21.15.57:0/3122574464 wait complete. 2024-04-25T02:06:12.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:12.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.661 7f62629c3700 1 Processor -- start 2024-04-25T02:06:12.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.661 7f62629c3700 1 -- start start 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f62629c3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0f5990 0x7f625c10b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f62629c3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f625c10b6c0 0x7f625c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f62629c3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c1a09f0 con 0x7f625c10bb10 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f62629c3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c0fa510 con 0x7f625c10b6c0 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f62629c3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c1a0c10 con 0x7f625c0f5990 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f625b5eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0f5990 0x7f625c10b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f625b5eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0f5990 0x7f625c10b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36700/0 (socket says 172.21.15.57:36700) 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f625b5eb700 1 -- 172.21.15.57:0/1003742724 learned_addr learned my addr 172.21.15.57:0/1003742724 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f6252dea700 1 --2- 172.21.15.57:0/1003742724 >> v2:172.21.15.57:3300/0 conn(0x7f625c10b6c0 0x7f625c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f625b5eb700 1 -- 172.21.15.57:0/1003742724 >> v2:172.21.15.57:3300/0 conn(0x7f625c10b6c0 msgr2=0x7f625c19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.662 7f625b5eb700 1 --2- 172.21.15.57:0/1003742724 >> v2:172.21.15.57:3300/0 conn(0x7f625c10b6c0 0x7f625c19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f625b5eb700 1 -- 172.21.15.57:0/1003742724 >> v1:172.21.15.57:6789/0 conn(0x7f625c10bb10 legacy=0x7f625c1a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f625b5eb700 1 -- 172.21.15.57:0/1003742724 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c1a9350 con 0x7f625c0f5990 2024-04-25T02:06:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f625b5eb700 1 --2- 172.21.15.57:0/1003742724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0f5990 0x7f625c10b090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f624c002f70 tx=0x7f624c0099d0).ready entity=mon.1 client_cookie=b1de9b6953e2aca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f625adea700 1 -- 172.21.15.57:0/1003742724 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f625c1a9350 con 0x7f625c0f5990 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f625adea700 1 -- 172.21.15.57:0/1003742724 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c00f510 con 0x7f625c0f5990 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f625adea700 1 -- 172.21.15.57:0/1003742724 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f624c00f6f0 con 0x7f625c0f5990 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f62629c3700 1 -- 172.21.15.57:0/1003742724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0f5990 msgr2=0x7f625c10b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f62629c3700 1 --2- 172.21.15.57:0/1003742724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0f5990 0x7f625c10b090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f624c002f70 tx=0x7f624c0099d0).stop 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f62629c3700 1 -- 172.21.15.57:0/1003742724 shutdown_connections 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f62629c3700 1 --2- 172.21.15.57:0/1003742724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0f5990 0x7f625c10b090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f62629c3700 1 --2- 172.21.15.57:0/1003742724 >> v2:172.21.15.57:3300/0 conn(0x7f625c10b6c0 0x7f625c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f62629c3700 1 -- 172.21.15.57:0/1003742724 >> 172.21.15.57:0/1003742724 conn(0x7f625c1139f0 msgr2=0x7f625c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f62629c3700 1 -- 172.21.15.57:0/1003742724 shutdown_connections 2024-04-25T02:06:12.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.663 7f62629c3700 1 -- 172.21.15.57:0/1003742724 wait complete. 2024-04-25T02:06:12.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.687 7f62629c3700 1 Processor -- start 2024-04-25T02:06:12.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.687 7f62629c3700 1 -- start start 2024-04-25T02:06:12.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f62629c3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0d6150 0x7f625c0d65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f62629c3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f625c0d6bd0 0x7f625c0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f62629c3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f625c0ce600 0x7f625c1b9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f62629c3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0f1eb0 con 0x7f625c0ce600 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f62629c3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c1a5c90 con 0x7f625c0d6150 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f62629c3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0f1b20 con 0x7f625c0d6bd0 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625b5eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0d6150 0x7f625c0d65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f6252dea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f625c0d6bd0 0x7f625c0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625bdec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f625c0ce600 0x7f625c1b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625b5eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0d6150 0x7f625c0d65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36708/0 (socket says 172.21.15.57:36708) 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625b5eb700 1 -- 172.21.15.57:0/2462169209 learned_addr learned my addr 172.21.15.57:0/2462169209 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f6252dea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f625c0d6bd0 0x7f625c0cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33292/0 (socket says 172.21.15.57:33292) 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625b5eb700 1 -- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f625c0d6bd0 msgr2=0x7f625c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625b5eb700 1 --2- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f625c0d6bd0 0x7f625c0cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625b5eb700 1 -- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f625c0ce600 msgr2=0x7f625c1b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625b5eb700 1 --2- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f625c0ce600 0x7f625c1b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625b5eb700 1 -- 172.21.15.57:0/2462169209 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0f2570 con 0x7f625c0d6150 2024-04-25T02:06:12.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.688 7f625bdec700 1 --2- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f625c0ce600 0x7f625c1b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.689 7f625b5eb700 1 --2- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0d6150 0x7f625c0d65a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f624c002f70 tx=0x7f624c0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.689 7f62595e7700 1 -- 172.21.15.57:0/2462169209 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f625c0f2570 con 0x7f625c0d6150 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.689 7f62595e7700 1 -- 172.21.15.57:0/2462169209 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c011a30 con 0x7f625c0d6150 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.689 7f62629c3700 1 -- 172.21.15.57:0/2462169209 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c0cea50 con 0x7f625c0d6150 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.689 7f62595e7700 1 -- 172.21.15.57:0/2462169209 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f624c011e00 con 0x7f625c0d6150 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.689 7f62629c3700 1 -- 172.21.15.57:0/2462169209 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c0cbdc0 con 0x7f625c0d6150 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.689 7f62595e7700 1 -- 172.21.15.57:0/2462169209 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f624c006a50 con 0x7f625c0d6150 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.689 7f62595e7700 1 -- 172.21.15.57:0/2462169209 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f624c001790 con 0x7f625c0d6150 2024-04-25T02:06:12.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.690 7f62629c3700 1 -- 172.21.15.57:0/2462169209 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c0f0860 con 0x7f625c0d6150 2024-04-25T02:06:12.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.693 7f62595e7700 1 -- 172.21.15.57:0/2462169209 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f624c011820 con 0x7f625c0d6150 2024-04-25T02:06:12.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.805 7f62629c3700 1 -- 172.21.15.57:0/2462169209 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f625c1ac6b0 con 0x7f625c0d6150 2024-04-25T02:06:12.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.805 7f62595e7700 1 -- 172.21.15.57:0/2462169209 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f624c00f300 con 0x7f625c0d6150 2024-04-25T02:06:12.812 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:12.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 -- 172.21.15.57:0/2462169209 >> v1:172.21.15.57:6816/43033 conn(0x7f62400145b0 legacy=0x7f6240016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 -- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0d6150 msgr2=0x7f625c0d65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 --2- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0d6150 0x7f625c0d65a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f624c002f70 tx=0x7f624c0068c0).stop 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 -- 172.21.15.57:0/2462169209 shutdown_connections 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 --2- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f625c0ce600 0x7f625c1b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 --2- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f625c0d6150 0x7f625c0d65a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 --2- 172.21.15.57:0/2462169209 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f625c0d6bd0 0x7f625c0cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 -- 172.21.15.57:0/2462169209 >> 172.21.15.57:0/2462169209 conn(0x7f625c0c3a10 msgr2=0x7f625c0dafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 -- 172.21.15.57:0/2462169209 shutdown_connections 2024-04-25T02:06:12.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.807 7f62629c3700 1 -- 172.21.15.57:0/2462169209 wait complete. 2024-04-25T02:06:12.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.951 7fd33c2d5700 1 Processor -- start 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.951 7fd33c2d5700 1 -- start start 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.951 7fd33c2d5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd334106530 0x7fd33410e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.951 7fd33c2d5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd33410ea90 0x7fd3340f1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.951 7fd33c2d5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3340f1e30 con 0x7fd33410eee0 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.951 7fd33c2d5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340fb670 con 0x7fd33410ea90 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.951 7fd33c2d5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd334106980 con 0x7fd334106530 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3390d0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd334106530 0x7fd33410e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3398d1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd33410eee0 0x7fd3340f1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52038/0 (socket says 172.21.15.57:52038) 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3398d1700 1 -- 172.21.15.57:0/2444882631 learned_addr learned my addr 172.21.15.57:0/2444882631 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:12.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3388cf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd33410ea90 0x7fd3340f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd323fff700 1 -- 172.21.15.57:0/2444882631 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115241553 0 0) 0x7fd32c001490 con 0x7fd33410eee0 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd323fff700 1 -- 172.21.15.57:0/2444882631 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd31c003270 con 0x7fd33410eee0 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3388cf700 1 -- 172.21.15.57:0/2444882631 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd334106530 msgr2=0x7fd33410e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3388cf700 1 --2- 172.21.15.57:0/2444882631 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd334106530 0x7fd33410e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3388cf700 1 -- 172.21.15.57:0/2444882631 >> v1:172.21.15.57:6789/0 conn(0x7fd33410eee0 legacy=0x7fd3340f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3388cf700 1 -- 172.21.15.57:0/2444882631 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3341ac7c0 con 0x7fd33410ea90 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3390d0700 1 --2- 172.21.15.57:0/2444882631 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd334106530 0x7fd33410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd3388cf700 1 --2- 172.21.15.57:0/2444882631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd33410ea90 0x7fd3340f1000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd3340fb820 tx=0x7fd33000ba50).ready entity=mon.1 client_cookie=69ee6cb2208c365b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd323fff700 1 -- 172.21.15.57:0/2444882631 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3341ac7c0 con 0x7fd33410ea90 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd323fff700 1 -- 172.21.15.57:0/2444882631 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33000d570 con 0x7fd33410ea90 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd323fff700 1 -- 172.21.15.57:0/2444882631 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd33000d940 con 0x7fd33410ea90 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd33c2d5700 1 -- 172.21.15.57:0/2444882631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd33410ea90 msgr2=0x7fd3340f1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.952 7fd33c2d5700 1 --2- 172.21.15.57:0/2444882631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd33410ea90 0x7fd3340f1000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd3340fb820 tx=0x7fd33000ba50).stop 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.953 7fd33c2d5700 1 -- 172.21.15.57:0/2444882631 shutdown_connections 2024-04-25T02:06:12.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.953 7fd33c2d5700 1 --2- 172.21.15.57:0/2444882631 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd334106530 0x7fd33410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.953 7fd33c2d5700 1 --2- 172.21.15.57:0/2444882631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd33410ea90 0x7fd3340f1000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.953 7fd33c2d5700 1 -- 172.21.15.57:0/2444882631 >> 172.21.15.57:0/2444882631 conn(0x7fd334114940 msgr2=0x7fd334114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:12.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.953 7fd33c2d5700 1 -- 172.21.15.57:0/2444882631 shutdown_connections 2024-04-25T02:06:12.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.953 7fd33c2d5700 1 -- 172.21.15.57:0/2444882631 wait complete. 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd33c2d5700 1 Processor -- start 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd33c2d5700 1 -- start start 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd33c2d5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3340cc560 0x7fd3340d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd33c2d5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3340d5a10 0x7fd3341b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd33c2d5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3340d5e60 0x7fd3341b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd33c2d5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340cbf60 con 0x7fd3340d5e60 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd33c2d5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3341b5170 con 0x7fd3340d5a10 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd33c2d5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3341b53a0 con 0x7fd3340cc560 2024-04-25T02:06:12.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd3390d0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3340cc560 0x7fd3340d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd3388cf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3340d5a10 0x7fd3341b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd3398d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3340d5e60 0x7fd3341b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd3390d0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3340cc560 0x7fd3340d53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33312/0 (socket says 172.21.15.57:33312) 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.977 7fd3390d0700 1 -- 172.21.15.57:0/1844644576 learned_addr learned my addr 172.21.15.57:0/1844644576 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3388cf700 1 -- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3340cc560 msgr2=0x7fd3340d53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3388cf700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3340cc560 0x7fd3340d53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3388cf700 1 -- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3340d5e60 msgr2=0x7fd3341b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3388cf700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3340d5e60 0x7fd3341b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3388cf700 1 -- 172.21.15.57:0/1844644576 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3341bbd10 con 0x7fd3340d5a10 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3390d0700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3340cc560 0x7fd3340d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3398d1700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3340d5e60 0x7fd3341b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3388cf700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3340d5a10 0x7fd3341b4510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd3340fb820 tx=0x7fd3300068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3227fc700 1 -- 172.21.15.57:0/1844644576 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd3341bbd10 con 0x7fd3340d5a10 2024-04-25T02:06:12.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3227fc700 1 -- 172.21.15.57:0/1844644576 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3300116e0 con 0x7fd3340d5a10 2024-04-25T02:06:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3341bbf10 con 0x7fd3340d5a10 2024-04-25T02:06:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd3227fc700 1 -- 172.21.15.57:0/1844644576 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd330017040 con 0x7fd3340d5a10 2024-04-25T02:06:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.978 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3341bc2f0 con 0x7fd3340d5a10 2024-04-25T02:06:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.979 7fd3227fc700 1 -- 172.21.15.57:0/1844644576 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd330011ab0 con 0x7fd3340d5a10 2024-04-25T02:06:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.979 7fd3227fc700 1 -- 172.21.15.57:0/1844644576 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd330018070 con 0x7fd3340d5a10 2024-04-25T02:06:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.979 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3340f08e0 con 0x7fd3340d5a10 2024-04-25T02:06:12.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:12.982 7fd3227fc700 1 -- 172.21.15.57:0/1844644576 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd33000d360 con 0x7fd3340d5a10 2024-04-25T02:06:13.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.092 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3340a61a0 con 0x7fd3340d5a10 2024-04-25T02:06:13.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.092 7fd3227fc700 1 -- 172.21.15.57:0/1844644576 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd3300114d0 con 0x7fd3340d5a10 2024-04-25T02:06:13.099 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:13.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 >> v1:172.21.15.57:6816/43033 conn(0x7fd3140145b0 legacy=0x7fd314016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3340d5a10 msgr2=0x7fd3341b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3340d5a10 0x7fd3341b4510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd3340fb820 tx=0x7fd3300068c0).stop 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 shutdown_connections 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3340d5e60 0x7fd3341b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3340cc560 0x7fd3340d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 --2- 172.21.15.57:0/1844644576 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3340d5a10 0x7fd3341b4510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 >> 172.21.15.57:0/1844644576 conn(0x7fd3340cb640 msgr2=0x7fd3340d66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 shutdown_connections 2024-04-25T02:06:13.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.094 7fd33c2d5700 1 -- 172.21.15.57:0/1844644576 wait complete. 2024-04-25T02:06:13.140 INFO:tasks.cephfs_test_runner:Starting test: test_newops_getvxattr (tasks.cephfs.test_newops.TestNewOps) For nautilus it will crash the MDSs when receive unknown OPs, as a workaround 2024-04-25T02:06:13.140 INFO:tasks.cephfs_test_runner:test_newops_getvxattr (tasks.cephfs.test_newops.TestNewOps) 2024-04-25T02:06:13.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:13.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.265 7f3330cd5700 1 Processor -- start 2024-04-25T02:06:13.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.265 7f3330cd5700 1 -- start start 2024-04-25T02:06:13.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f3330cd5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0f5920 0x7f332c0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f3330cd5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c0f1ec0 0x7f332c10e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f3330cd5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f332c0f2310 0x7f332c10e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f3330cd5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0f9230 con 0x7f332c0f2310 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f3330cd5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c10ef10 con 0x7f332c0f5920 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f3330cd5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f332c1aa660 con 0x7f332c0f1ec0 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f3329a8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0f5920 0x7f332c0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f332928a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c0f1ec0 0x7f332c10e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f332a28c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f332c0f2310 0x7f332c10e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f332928a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c0f1ec0 0x7f332c10e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33318/0 (socket says 172.21.15.57:33318) 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f3329a8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0f5920 0x7f332c0f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36732/0 (socket says 172.21.15.57:36732) 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.266 7f332928a700 1 -- 172.21.15.57:0/2448284062 learned_addr learned my addr 172.21.15.57:0/2448284062 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f332928a700 1 -- 172.21.15.57:0/2448284062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0f5920 msgr2=0x7f332c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f332928a700 1 --2- 172.21.15.57:0/2448284062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0f5920 0x7f332c0f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f332928a700 1 -- 172.21.15.57:0/2448284062 >> v2:172.21.15.57:3300/0 conn(0x7f332c0f2310 msgr2=0x7f332c10e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f332928a700 1 --2- 172.21.15.57:0/2448284062 >> v2:172.21.15.57:3300/0 conn(0x7f332c0f2310 0x7f332c10e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f332928a700 1 -- 172.21.15.57:0/2448284062 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c1aa810 con 0x7f332c0f1ec0 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f3329a8b700 1 --2- 172.21.15.57:0/2448284062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0f5920 0x7f332c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f332a28c700 1 --2- 172.21.15.57:0/2448284062 >> v2:172.21.15.57:3300/0 conn(0x7f332c0f2310 0x7f332c10e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f332928a700 1 --2- 172.21.15.57:0/2448284062 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c0f1ec0 0x7f332c10e2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3320002f70 tx=0x7f33200099d0).ready entity=mon.2 client_cookie=d87c97dbd5bce825 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f3328a89700 1 -- 172.21.15.57:0/2448284062 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f332c1aa810 con 0x7f332c0f1ec0 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f3328a89700 1 -- 172.21.15.57:0/2448284062 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332000f510 con 0x7f332c0f1ec0 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f3328a89700 1 -- 172.21.15.57:0/2448284062 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f332000f6f0 con 0x7f332c0f1ec0 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f3330cd5700 1 -- 172.21.15.57:0/2448284062 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c0f1ec0 msgr2=0x7f332c10e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.267 7f3330cd5700 1 --2- 172.21.15.57:0/2448284062 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c0f1ec0 0x7f332c10e2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3320002f70 tx=0x7f33200099d0).stop 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.268 7f3330cd5700 1 -- 172.21.15.57:0/2448284062 shutdown_connections 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.268 7f3330cd5700 1 --2- 172.21.15.57:0/2448284062 >> v2:172.21.15.57:3300/0 conn(0x7f332c0f2310 0x7f332c10e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.268 7f3330cd5700 1 --2- 172.21.15.57:0/2448284062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0f5920 0x7f332c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.268 7f3330cd5700 1 --2- 172.21.15.57:0/2448284062 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c0f1ec0 0x7f332c10e2b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.268 7f3330cd5700 1 -- 172.21.15.57:0/2448284062 >> 172.21.15.57:0/2448284062 conn(0x7f332c113a70 msgr2=0x7f332c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.268 7f3330cd5700 1 -- 172.21.15.57:0/2448284062 shutdown_connections 2024-04-25T02:06:13.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.268 7f3330cd5700 1 -- 172.21.15.57:0/2448284062 wait complete. 2024-04-25T02:06:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.291 7f3330cd5700 1 Processor -- start 2024-04-25T02:06:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3330cd5700 1 -- start start 2024-04-25T02:06:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3330cd5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c1b48b0 0x7f332c1b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3330cd5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c1b5330 0x7f332c0dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3330cd5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0dc6d0 0x7f332c1bbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3330cd5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0f0250 con 0x7f332c0dc6d0 2024-04-25T02:06:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3330cd5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0da8c0 con 0x7f332c1b48b0 2024-04-25T02:06:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3330cd5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0be8c0 con 0x7f332c1b5330 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3329a8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c1b48b0 0x7f332c1b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332928a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c1b5330 0x7f332c0dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332a28c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0dc6d0 0x7f332c1bbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3329a8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c1b48b0 0x7f332c1b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36740/0 (socket says 172.21.15.57:36740) 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3329a8b700 1 -- 172.21.15.57:0/388299756 learned_addr learned my addr 172.21.15.57:0/388299756 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332928a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c1b5330 0x7f332c0dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33326/0 (socket says 172.21.15.57:33326) 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332a28c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0dc6d0 0x7f332c1bbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60272/0 (socket says 172.21.15.57:60272) 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332a28c700 1 -- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c1b5330 msgr2=0x7f332c0dc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332a28c700 1 --2- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c1b5330 0x7f332c0dc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332a28c700 1 -- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c1b48b0 msgr2=0x7f332c1b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332a28c700 1 --2- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c1b48b0 0x7f332c1b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332a28c700 1 -- 172.21.15.57:0/388299756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c0d9ef0 con 0x7f332c0dc6d0 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f3329a8b700 1 --2- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c1b48b0 0x7f332c1b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.292 7f332a28c700 1 --2- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0dc6d0 0x7f332c1bbed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f332c0bee80 tx=0x7f332400eda0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:13.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.293 7f331affd700 1 -- 172.21.15.57:0/388299756 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f332c0d9ef0 con 0x7f332c0dc6d0 2024-04-25T02:06:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.293 7f331affd700 1 -- 172.21.15.57:0/388299756 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400c880 con 0x7f332c0dc6d0 2024-04-25T02:06:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.293 7f3330cd5700 1 -- 172.21.15.57:0/388299756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c0dcb20 con 0x7f332c0dc6d0 2024-04-25T02:06:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.293 7f331affd700 1 -- 172.21.15.57:0/388299756 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f332400f040 con 0x7f332c0dc6d0 2024-04-25T02:06:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.293 7f3330cd5700 1 -- 172.21.15.57:0/388299756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c1bc500 con 0x7f332c0dc6d0 2024-04-25T02:06:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.293 7f331affd700 1 -- 172.21.15.57:0/388299756 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3324022060 con 0x7f332c0dc6d0 2024-04-25T02:06:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.293 7f331affd700 1 -- 172.21.15.57:0/388299756 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3324010040 con 0x7f332c0dc6d0 2024-04-25T02:06:13.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.294 7f3330cd5700 1 -- 172.21.15.57:0/388299756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c0f08e0 con 0x7f332c0dc6d0 2024-04-25T02:06:13.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.297 7f331affd700 1 -- 172.21.15.57:0/388299756 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f332400c670 con 0x7f332c0dc6d0 2024-04-25T02:06:13.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.408 7f3330cd5700 1 -- 172.21.15.57:0/388299756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f332c0d4f80 con 0x7f332c0dc6d0 2024-04-25T02:06:13.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.409 7f331affd700 1 -- 172.21.15.57:0/388299756 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f332c1145f0 con 0x7f332c0dc6d0 2024-04-25T02:06:13.415 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:13.415 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 -- 172.21.15.57:0/388299756 >> v1:172.21.15.57:6816/43033 conn(0x7f33080145b0 legacy=0x7f3308016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 -- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0dc6d0 msgr2=0x7f332c1bbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 --2- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0dc6d0 0x7f332c1bbed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f332c0bee80 tx=0x7f332400eda0).stop 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 -- 172.21.15.57:0/388299756 shutdown_connections 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 --2- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0dc6d0 0x7f332c1bbed0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 --2- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c1b48b0 0x7f332c1b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 --2- 172.21.15.57:0/388299756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f332c1b5330 0x7f332c0dc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 -- 172.21.15.57:0/388299756 >> 172.21.15.57:0/388299756 conn(0x7f332c0dea50 msgr2=0x7f332c0d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 -- 172.21.15.57:0/388299756 shutdown_connections 2024-04-25T02:06:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.410 7f3330cd5700 1 -- 172.21.15.57:0/388299756 wait complete. 2024-04-25T02:06:13.428 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:13.429 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.556 7f78763da700 1 Processor -- start 2024-04-25T02:06:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.556 7f78763da700 1 -- start start 2024-04-25T02:06:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f78763da700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f787010b910 0x7f78701a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f78763da700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78701a59d0 0x7f78701a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f78763da700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787010bd60 con 0x7f78700f5a10 2024-04-25T02:06:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f78763da700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78700fa590 con 0x7f787010b910 2024-04-25T02:06:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f78763da700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78701a0c50 con 0x7f78701a59d0 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786e885700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f787010b910 0x7f78701a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786f887700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78701a59d0 0x7f78701a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786f086700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f78700f5a10 0x7f787010b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52042/0 (socket says 172.21.15.57:52042) 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786e885700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f787010b910 0x7f78701a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60284/0 (socket says 172.21.15.57:60284) 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786f086700 1 -- 172.21.15.57:0/3482358946 learned_addr learned my addr 172.21.15.57:0/3482358946 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786f887700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78701a59d0 0x7f78701a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36754/0 (socket says 172.21.15.57:36754) 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786e885700 1 -- 172.21.15.57:0/3482358946 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78701a59d0 msgr2=0x7f78701a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786e885700 1 --2- 172.21.15.57:0/3482358946 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78701a59d0 0x7f78701a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786e885700 1 -- 172.21.15.57:0/3482358946 >> v1:172.21.15.57:6789/0 conn(0x7f78700f5a10 legacy=0x7f787010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786e084700 1 -- 172.21.15.57:0/3482358946 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928929870 0 0) 0x7f7860001490 con 0x7f78700f5a10 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.557 7f786e885700 1 -- 172.21.15.57:0/3482358946 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78701a9470 con 0x7f787010b910 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f786e885700 1 --2- 172.21.15.57:0/3482358946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f787010b910 0x7f78701a53a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7870103a10 tx=0x7f785800dc80).ready entity=mon.0 client_cookie=75017a6f941632fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f786e084700 1 -- 172.21.15.57:0/3482358946 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78701a9470 con 0x7f787010b910 2024-04-25T02:06:13.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f786e084700 1 -- 172.21.15.57:0/3482358946 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800bba0 con 0x7f787010b910 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f786e084700 1 -- 172.21.15.57:0/3482358946 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7858015070 con 0x7f787010b910 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f78763da700 1 -- 172.21.15.57:0/3482358946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f787010b910 msgr2=0x7f78701a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f78763da700 1 --2- 172.21.15.57:0/3482358946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f787010b910 0x7f78701a53a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7870103a10 tx=0x7f785800dc80).stop 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f78763da700 1 -- 172.21.15.57:0/3482358946 shutdown_connections 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f78763da700 1 --2- 172.21.15.57:0/3482358946 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78701a59d0 0x7f78701a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f78763da700 1 --2- 172.21.15.57:0/3482358946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f787010b910 0x7f78701a53a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f78763da700 1 -- 172.21.15.57:0/3482358946 >> 172.21.15.57:0/3482358946 conn(0x7f7870113a70 msgr2=0x7f78700f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f78763da700 1 -- 172.21.15.57:0/3482358946 shutdown_connections 2024-04-25T02:06:13.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.558 7f78763da700 1 -- 172.21.15.57:0/3482358946 wait complete. 2024-04-25T02:06:13.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.582 7f78763da700 1 Processor -- start 2024-04-25T02:06:13.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.582 7f78763da700 1 -- start start 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.582 7f78763da700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78700dd370 0x7f78700cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.582 7f78763da700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78700cca00 0x7f78701b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f78763da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78700cce50 0x7f78701b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f78763da700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78700dca50 con 0x7f78700cce50 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f78763da700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700dcda0 con 0x7f78700cca00 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f78763da700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78701b1070 con 0x7f78700dd370 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78700cce50 0x7f78701b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786e885700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78700cca00 0x7f78701b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78700cce50 0x7f78701b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60288/0 (socket says 172.21.15.57:60288) 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 -- 172.21.15.57:0/2318053494 learned_addr learned my addr 172.21.15.57:0/2318053494 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f086700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78700dd370 0x7f78700cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 -- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78700dd370 msgr2=0x7f78700cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78700dd370 0x7f78700cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 -- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78700cca00 msgr2=0x7f78701b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78700cca00 0x7f78701b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 -- 172.21.15.57:0/2318053494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78701b12a0 con 0x7f78700cce50 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786e885700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78700cca00 0x7f78701b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786f887700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78700cce50 0x7f78701b0a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f78700dcf50 tx=0x7f786800ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786c881700 1 -- 172.21.15.57:0/2318053494 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78701b12a0 con 0x7f78700cce50 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786c881700 1 -- 172.21.15.57:0/2318053494 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786800c7b0 con 0x7f78700cce50 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f786c881700 1 -- 172.21.15.57:0/2318053494 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f786800f040 con 0x7f78700cce50 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f78763da700 1 -- 172.21.15.57:0/2318053494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78701b7b80 con 0x7f78700cce50 2024-04-25T02:06:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.583 7f78763da700 1 -- 172.21.15.57:0/2318053494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78701b7f60 con 0x7f78700cce50 2024-04-25T02:06:13.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.584 7f786c881700 1 -- 172.21.15.57:0/2318053494 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7868011070 con 0x7f78700cce50 2024-04-25T02:06:13.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.584 7f786c881700 1 -- 172.21.15.57:0/2318053494 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7868010040 con 0x7f78700cce50 2024-04-25T02:06:13.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.584 7f78763da700 1 -- 172.21.15.57:0/2318053494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78700f08e0 con 0x7f78700cce50 2024-04-25T02:06:13.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.588 7f786c881700 1 -- 172.21.15.57:0/2318053494 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f786800c5a0 con 0x7f78700cce50 2024-04-25T02:06:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.700 7f78763da700 1 -- 172.21.15.57:0/2318053494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78701aab30 con 0x7f78700cce50 2024-04-25T02:06:13.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.700 7f786c881700 1 -- 172.21.15.57:0/2318053494 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78701145f0 con 0x7f78700cce50 2024-04-25T02:06:13.707 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 -- 172.21.15.57:0/2318053494 >> v1:172.21.15.57:6816/43033 conn(0x7f78540145b0 legacy=0x7f7854016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 -- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78700cce50 msgr2=0x7f78701b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78700cce50 0x7f78701b0a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f78700dcf50 tx=0x7f786800ed00).stop 2024-04-25T02:06:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 -- 172.21.15.57:0/2318053494 shutdown_connections 2024-04-25T02:06:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78700cce50 0x7f78701b0a40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78700dd370 0x7f78700cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 --2- 172.21.15.57:0/2318053494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78700cca00 0x7f78701b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 -- 172.21.15.57:0/2318053494 >> 172.21.15.57:0/2318053494 conn(0x7f78700e0ab0 msgr2=0x7f78700cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 -- 172.21.15.57:0/2318053494 shutdown_connections 2024-04-25T02:06:13.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.701 7f78763da700 1 -- 172.21.15.57:0/2318053494 wait complete. 2024-04-25T02:06:13.719 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:13.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.846 7f01ae537700 1 Processor -- start 2024-04-25T02:06:13.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01ae537700 1 -- start start 2024-04-25T02:06:13.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01ae537700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f01a80f5920 0x7f01a810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01ae537700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a810c970 0x7f01a80f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01ae537700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a810cdc0 0x7f01a80f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01ae537700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80fa290 con 0x7f01a80f5920 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01ae537700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80f95c0 con 0x7f01a810cdc0 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01ae537700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80f24f0 con 0x7f01a810c970 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01a72c1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f01a80f5920 0x7f01a810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01a6ac0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a810c970 0x7f01a80f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01a7ac2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a810cdc0 0x7f01a80f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01a72c1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f01a80f5920 0x7f01a810c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60302/0 (socket says 172.21.15.57:60302) 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01a6ac0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a810c970 0x7f01a80f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33342/0 (socket says 172.21.15.57:33342) 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.847 7f01a72c1700 1 -- 172.21.15.57:0/691194424 learned_addr learned my addr 172.21.15.57:0/691194424 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a7ac2700 1 -- 172.21.15.57:0/691194424 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a810c970 msgr2=0x7f01a80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a7ac2700 1 --2- 172.21.15.57:0/691194424 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a810c970 0x7f01a80f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a7ac2700 1 -- 172.21.15.57:0/691194424 >> v2:172.21.15.57:3300/0 conn(0x7f01a80f5920 msgr2=0x7f01a810c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:13.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a7ac2700 1 --2- 172.21.15.57:0/691194424 >> v2:172.21.15.57:3300/0 conn(0x7f01a80f5920 0x7f01a810c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a7ac2700 1 -- 172.21.15.57:0/691194424 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80f2720 con 0x7f01a810cdc0 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a72c1700 1 --2- 172.21.15.57:0/691194424 >> v2:172.21.15.57:3300/0 conn(0x7f01a80f5920 0x7f01a810c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a6ac0700 1 --2- 172.21.15.57:0/691194424 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a810c970 0x7f01a80f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a7ac2700 1 --2- 172.21.15.57:0/691194424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a810cdc0 0x7f01a80f1ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f01a80f4640 tx=0x7f01a0009d40).ready entity=mon.1 client_cookie=6494f6c1cd5607d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a62bf700 1 -- 172.21.15.57:0/691194424 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01a80f2720 con 0x7f01a810cdc0 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a62bf700 1 -- 172.21.15.57:0/691194424 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000b7c0 con 0x7f01a810cdc0 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01a62bf700 1 -- 172.21.15.57:0/691194424 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01a000b9a0 con 0x7f01a810cdc0 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01ae537700 1 -- 172.21.15.57:0/691194424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a810cdc0 msgr2=0x7f01a80f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01ae537700 1 --2- 172.21.15.57:0/691194424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a810cdc0 0x7f01a80f1ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f01a80f4640 tx=0x7f01a0009d40).stop 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01ae537700 1 -- 172.21.15.57:0/691194424 shutdown_connections 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01ae537700 1 --2- 172.21.15.57:0/691194424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a810cdc0 0x7f01a80f1ec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01ae537700 1 --2- 172.21.15.57:0/691194424 >> v2:172.21.15.57:3300/0 conn(0x7f01a80f5920 0x7f01a810c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01ae537700 1 --2- 172.21.15.57:0/691194424 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a810c970 0x7f01a80f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.848 7f01ae537700 1 -- 172.21.15.57:0/691194424 >> 172.21.15.57:0/691194424 conn(0x7f01a8113a70 msgr2=0x7f01a80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.849 7f01ae537700 1 -- 172.21.15.57:0/691194424 shutdown_connections 2024-04-25T02:06:13.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.849 7f01ae537700 1 -- 172.21.15.57:0/691194424 wait complete. 2024-04-25T02:06:13.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.872 7f01ae537700 1 Processor -- start 2024-04-25T02:06:13.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01ae537700 1 -- start start 2024-04-25T02:06:13.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01ae537700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a81a84a0 0x7f01a81a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01ae537700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a81a8f20 0x7f01a81b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01ae537700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01a81b4b60 0x7f01a81b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:13.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01ae537700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80db990 con 0x7f01a81b4b60 2024-04-25T02:06:13.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01ae537700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80f7970 con 0x7f01a81a8f20 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01ae537700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80dbc90 con 0x7f01a81a84a0 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a72c1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a81a84a0 0x7f01a81a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a7ac2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01a81b4b60 0x7f01a81b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a72c1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a81a84a0 0x7f01a81a88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33346/0 (socket says 172.21.15.57:33346) 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a7ac2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01a81b4b60 0x7f01a81b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60304/0 (socket says 172.21.15.57:60304) 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a72c1700 1 -- 172.21.15.57:0/991070541 learned_addr learned my addr 172.21.15.57:0/991070541 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a6ac0700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a81a8f20 0x7f01a81b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a72c1700 1 -- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a81a8f20 msgr2=0x7f01a81b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a72c1700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a81a8f20 0x7f01a81b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a72c1700 1 -- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01a81b4b60 msgr2=0x7f01a81b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a72c1700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01a81b4b60 0x7f01a81b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a72c1700 1 -- 172.21.15.57:0/991070541 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80dc790 con 0x7f01a81a84a0 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.873 7f01a7ac2700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01a81b4b60 0x7f01a81b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.874 7f01a72c1700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a81a84a0 0x7f01a81a88f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f01a80d9aa0 tx=0x7f019800ecb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:13.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.874 7f01a4abc700 1 -- 172.21.15.57:0/991070541 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01a80dc790 con 0x7f01a81a84a0 2024-04-25T02:06:13.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.874 7f01a4abc700 1 -- 172.21.15.57:0/991070541 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800c5c0 con 0x7f01a81a84a0 2024-04-25T02:06:13.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.874 7f01ae537700 1 -- 172.21.15.57:0/991070541 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a81bbd30 con 0x7f01a81a84a0 2024-04-25T02:06:13.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.874 7f01a4abc700 1 -- 172.21.15.57:0/991070541 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f019800f040 con 0x7f01a81a84a0 2024-04-25T02:06:13.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.874 7f01ae537700 1 -- 172.21.15.57:0/991070541 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a81bc110 con 0x7f01a81a84a0 2024-04-25T02:06:13.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.874 7f01a4abc700 1 -- 172.21.15.57:0/991070541 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0198011070 con 0x7f01a81a84a0 2024-04-25T02:06:13.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.874 7f01a4abc700 1 -- 172.21.15.57:0/991070541 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f0198010040 con 0x7f01a81a84a0 2024-04-25T02:06:13.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.875 7f01ae537700 1 -- 172.21.15.57:0/991070541 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a80f08e0 con 0x7f01a81a84a0 2024-04-25T02:06:13.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.878 7f01a4abc700 1 -- 172.21.15.57:0/991070541 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f019800edf0 con 0x7f01a81a84a0 2024-04-25T02:06:13.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.989 7f01ae537700 1 -- 172.21.15.57:0/991070541 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01a81aec50 con 0x7f01a81a84a0 2024-04-25T02:06:13.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.989 7f01a4abc700 1 -- 172.21.15.57:0/991070541 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0198000c30 con 0x7f01a81a84a0 2024-04-25T02:06:13.996 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:13.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.990 7f01ae537700 1 -- 172.21.15.57:0/991070541 >> v1:172.21.15.57:6816/43033 conn(0x7f01880145b0 legacy=0x7f0188016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.990 7f01ae537700 1 -- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a81a84a0 msgr2=0x7f01a81a88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.990 7f01ae537700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a81a84a0 0x7f01a81a88f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f01a80d9aa0 tx=0x7f019800ecb0).stop 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.991 7f01ae537700 1 -- 172.21.15.57:0/991070541 shutdown_connections 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.991 7f01ae537700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01a81b4b60 0x7f01a81b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.991 7f01ae537700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01a81a84a0 0x7f01a81a88f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.991 7f01ae537700 1 --2- 172.21.15.57:0/991070541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01a81a8f20 0x7f01a81b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.991 7f01ae537700 1 -- 172.21.15.57:0/991070541 >> 172.21.15.57:0/991070541 conn(0x7f01a80c3520 msgr2=0x7f01a80c5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.991 7f01ae537700 1 -- 172.21.15.57:0/991070541 shutdown_connections 2024-04-25T02:06:13.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:13.991 7f01ae537700 1 -- 172.21.15.57:0/991070541 wait complete. 2024-04-25T02:06:14.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdced414700 1 Processor -- start 2024-04-25T02:06:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdced414700 1 -- start start 2024-04-25T02:06:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdced414700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdce80f2090 0x7fdce81a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdced414700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81a8c80 0x7fdce81ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdced414700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce80f9230 con 0x7fdce80f5920 2024-04-25T02:06:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdced414700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce80f24e0 con 0x7fdce80f2090 2024-04-25T02:06:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdced414700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81ac720 con 0x7fdce81a8c80 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdce585b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdce80f2090 0x7fdce81a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdce685d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81a8c80 0x7fdce81ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdce585b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdce80f2090 0x7fdce81a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60316/0 (socket says 172.21.15.57:60316) 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdce585b700 1 -- 172.21.15.57:0/3900007330 learned_addr learned my addr 172.21.15.57:0/3900007330 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.135 7fdce605c700 1 --1- 172.21.15.57:0/3900007330 >> v1:172.21.15.57:6789/0 conn(0x7fdce80f5920 0x7fdce80f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52052/0 (socket says 172.21.15.57:52052) 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce585b700 1 -- 172.21.15.57:0/3900007330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81a8c80 msgr2=0x7fdce81ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce585b700 1 --2- 172.21.15.57:0/3900007330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81a8c80 0x7fdce81ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce585b700 1 -- 172.21.15.57:0/3900007330 >> v1:172.21.15.57:6789/0 conn(0x7fdce80f5920 legacy=0x7fdce80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce585b700 1 -- 172.21.15.57:0/3900007330 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce81ac8d0 con 0x7fdce80f2090 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce685d700 1 --2- 172.21.15.57:0/3900007330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81a8c80 0x7fdce81ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce585b700 1 --2- 172.21.15.57:0/3900007330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80f2090 0x7fdce81a8650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fdce81037f0 tx=0x7fdcd0009a80).ready entity=mon.0 client_cookie=97f080b0fd622d8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce505a700 1 -- 172.21.15.57:0/3900007330 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdce81ac8d0 con 0x7fdce80f2090 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce505a700 1 -- 172.21.15.57:0/3900007330 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000f510 con 0x7fdce80f2090 2024-04-25T02:06:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdce505a700 1 -- 172.21.15.57:0/3900007330 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdcd000f6f0 con 0x7fdce80f2090 2024-04-25T02:06:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdced414700 1 -- 172.21.15.57:0/3900007330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80f2090 msgr2=0x7fdce81a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.136 7fdced414700 1 --2- 172.21.15.57:0/3900007330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80f2090 0x7fdce81a8650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fdce81037f0 tx=0x7fdcd0009a80).stop 2024-04-25T02:06:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.137 7fdced414700 1 -- 172.21.15.57:0/3900007330 shutdown_connections 2024-04-25T02:06:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.137 7fdced414700 1 --2- 172.21.15.57:0/3900007330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81a8c80 0x7fdce81ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.137 7fdced414700 1 --2- 172.21.15.57:0/3900007330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80f2090 0x7fdce81a8650 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.137 7fdced414700 1 -- 172.21.15.57:0/3900007330 >> 172.21.15.57:0/3900007330 conn(0x7fdce8113a70 msgr2=0x7fdce80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.137 7fdced414700 1 -- 172.21.15.57:0/3900007330 shutdown_connections 2024-04-25T02:06:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.137 7fdced414700 1 -- 172.21.15.57:0/3900007330 wait complete. 2024-04-25T02:06:14.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdced414700 1 Processor -- start 2024-04-25T02:06:14.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdced414700 1 -- start start 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdced414700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdce80d6750 0x7fdce80d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdced414700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80d71d0 0x7fdce81b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdced414700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81b4f80 0x7fdce81bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdced414700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80cefe0 con 0x7fdce80d71d0 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdced414700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80bc740 con 0x7fdce81b4f80 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdced414700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80c59a0 con 0x7fdce80d6750 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdce605c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdce80d6750 0x7fdce80d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdce585b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80d71d0 0x7fdce81b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdce685d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81b4f80 0x7fdce81bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdce585b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80d71d0 0x7fdce81b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60318/0 (socket says 172.21.15.57:60318) 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdce605c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdce80d6750 0x7fdce80d6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33358/0 (socket says 172.21.15.57:33358) 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.161 7fdce585b700 1 -- 172.21.15.57:0/2416391531 learned_addr learned my addr 172.21.15.57:0/2416391531 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:14.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdce585b700 1 -- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdce80d6750 msgr2=0x7fdce80d6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdce585b700 1 --2- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdce80d6750 0x7fdce80d6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdce585b700 1 -- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81b4f80 msgr2=0x7fdce81bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdce585b700 1 --2- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81b4f80 0x7fdce81bbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdce585b700 1 -- 172.21.15.57:0/2416391531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce80d7b90 con 0x7fdce80d71d0 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdce685d700 1 --2- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81b4f80 0x7fdce81bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdce585b700 1 --2- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80d71d0 0x7fdce81b4950 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdce81037f0 tx=0x7fdcd00068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdcdf7fe700 1 -- 172.21.15.57:0/2416391531 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdce80d7b90 con 0x7fdce80d71d0 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdcdf7fe700 1 -- 172.21.15.57:0/2416391531 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd0011690 con 0x7fdce80d71d0 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdcdf7fe700 1 -- 172.21.15.57:0/2416391531 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdcd0011a60 con 0x7fdce80d71d0 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.162 7fdced414700 1 -- 172.21.15.57:0/2416391531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce80cf570 con 0x7fdce80d71d0 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.163 7fdced414700 1 -- 172.21.15.57:0/2416391531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce81b53d0 con 0x7fdce80d71d0 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.163 7fdcdf7fe700 1 -- 172.21.15.57:0/2416391531 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fdcd0019030 con 0x7fdce80d71d0 2024-04-25T02:06:14.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.163 7fdcdf7fe700 1 -- 172.21.15.57:0/2416391531 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fdcd0018040 con 0x7fdce80d71d0 2024-04-25T02:06:14.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.164 7fdced414700 1 -- 172.21.15.57:0/2416391531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce80f08e0 con 0x7fdce80d71d0 2024-04-25T02:06:14.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.167 7fdcdf7fe700 1 -- 172.21.15.57:0/2416391531 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fdcd0011480 con 0x7fdce80d71d0 2024-04-25T02:06:14.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.277 7fdced414700 1 -- 172.21.15.57:0/2416391531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdce80cece0 con 0x7fdce80d71d0 2024-04-25T02:06:14.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.278 7fdcdf7fe700 1 -- 172.21.15.57:0/2416391531 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdcd000f300 con 0x7fdce80d71d0 2024-04-25T02:06:14.285 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 -- 172.21.15.57:0/2416391531 >> v1:172.21.15.57:6816/43033 conn(0x7fdccc0145b0 legacy=0x7fdccc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 -- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80d71d0 msgr2=0x7fdce81b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 --2- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80d71d0 0x7fdce81b4950 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdce81037f0 tx=0x7fdcd00068c0).stop 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 -- 172.21.15.57:0/2416391531 shutdown_connections 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 --2- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdce81b4f80 0x7fdce81bbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 --2- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdce80d6750 0x7fdce80d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 --2- 172.21.15.57:0/2416391531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdce80d71d0 0x7fdce81b4950 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 -- 172.21.15.57:0/2416391531 >> 172.21.15.57:0/2416391531 conn(0x7fdce80bd660 msgr2=0x7fdce80bb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:14.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 -- 172.21.15.57:0/2416391531 shutdown_connections 2024-04-25T02:06:14.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.279 7fdced414700 1 -- 172.21.15.57:0/2416391531 wait complete. 2024-04-25T02:06:14.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr' 2024-04-25T02:06:14.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.422 7f8a44fa5700 1 Processor -- start 2024-04-25T02:06:14.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.422 7f8a44fa5700 1 -- start start 2024-04-25T02:06:14.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a44fa5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a4010b910 0x7f8a401a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a44fa5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a401a59d0 0x7f8a401a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a44fa5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4010bd60 con 0x7f8a400f5a10 2024-04-25T02:06:14.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a44fa5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400fa590 con 0x7f8a4010b910 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a44fa5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a401a0c50 con 0x7f8a401a59d0 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3dd9f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8a400f5a10 0x7f8a4010b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52060/0 (socket says 172.21.15.57:52060) 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3e5a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a401a59d0 0x7f8a401a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3dd9f700 1 -- 172.21.15.57:0/844482789 learned_addr learned my addr 172.21.15.57:0/844482789 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3d59e700 1 --2- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a4010b910 0x7f8a401a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3cd9d700 1 -- 172.21.15.57:0/844482789 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250579801 0 0) 0x7f8a28001110 con 0x7f8a400f5a10 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3e5a0700 1 -- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a4010b910 msgr2=0x7f8a401a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3e5a0700 1 --2- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a4010b910 0x7f8a401a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3e5a0700 1 -- 172.21.15.57:0/844482789 >> v1:172.21.15.57:6789/0 conn(0x7f8a400f5a10 legacy=0x7f8a4010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3e5a0700 1 -- 172.21.15.57:0/844482789 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a401a9470 con 0x7f8a401a59d0 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3d59e700 1 --2- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a4010b910 0x7f8a401a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.423 7f8a3e5a0700 1 --2- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a401a59d0 0x7f8a401a7e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8a400f47c0 tx=0x7f8a38009cf0).ready entity=mon.2 client_cookie=11363e21bb79af23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a3cd9d700 1 -- 172.21.15.57:0/844482789 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a401a9470 con 0x7f8a401a59d0 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a3cd9d700 1 -- 172.21.15.57:0/844482789 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3800ba30 con 0x7f8a401a59d0 2024-04-25T02:06:14.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a3cd9d700 1 -- 172.21.15.57:0/844482789 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a3800be00 con 0x7f8a401a59d0 2024-04-25T02:06:14.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a44fa5700 1 -- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a401a59d0 msgr2=0x7f8a401a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a44fa5700 1 --2- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a401a59d0 0x7f8a401a7e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8a400f47c0 tx=0x7f8a38009cf0).stop 2024-04-25T02:06:14.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a44fa5700 1 -- 172.21.15.57:0/844482789 shutdown_connections 2024-04-25T02:06:14.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a44fa5700 1 --2- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a401a59d0 0x7f8a401a7e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a44fa5700 1 --2- 172.21.15.57:0/844482789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a4010b910 0x7f8a401a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a44fa5700 1 -- 172.21.15.57:0/844482789 >> 172.21.15.57:0/844482789 conn(0x7f8a40113a70 msgr2=0x7f8a400f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:14.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a44fa5700 1 -- 172.21.15.57:0/844482789 shutdown_connections 2024-04-25T02:06:14.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.424 7f8a44fa5700 1 -- 172.21.15.57:0/844482789 wait complete. 2024-04-25T02:06:14.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.448 7f8a44fa5700 1 Processor -- start 2024-04-25T02:06:14.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.448 7f8a44fa5700 1 -- start start 2024-04-25T02:06:14.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a44fa5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a400d9a80 0x7f8a400d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a44fa5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a400da500 0x7f8a401b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a44fa5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a401b4d60 0x7f8a401b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a44fa5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400e6600 con 0x7f8a400da500 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a44fa5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400c3ba0 con 0x7f8a401b4d60 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a44fa5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400de180 con 0x7f8a400d9a80 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a400d9a80 0x7f8a400d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3e5a0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a401b4d60 0x7f8a401b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a400d9a80 0x7f8a400d9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33376/0 (socket says 172.21.15.57:33376) 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 -- 172.21.15.57:0/2822764272 learned_addr learned my addr 172.21.15.57:0/2822764272 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3d59e700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a400da500 0x7f8a401b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 -- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a401b4d60 msgr2=0x7f8a401b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a401b4d60 0x7f8a401b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 -- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a400da500 msgr2=0x7f8a401b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a400da500 0x7f8a401b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 -- 172.21.15.57:0/2822764272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400de480 con 0x7f8a400d9a80 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3e5a0700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a401b4d60 0x7f8a401b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:14.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a3dd9f700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a400d9a80 0x7f8a400d9ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8a400c1a60 tx=0x7f8a2800c810).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:14.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a36ffd700 1 -- 172.21.15.57:0/2822764272 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a400de480 con 0x7f8a400d9a80 2024-04-25T02:06:14.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a36ffd700 1 -- 172.21.15.57:0/2822764272 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a280072e0 con 0x7f8a400d9a80 2024-04-25T02:06:14.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a401a1820 con 0x7f8a400d9a80 2024-04-25T02:06:14.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.449 7f8a36ffd700 1 -- 172.21.15.57:0/2822764272 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8a28005810 con 0x7f8a400d9a80 2024-04-25T02:06:14.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.450 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a401bbeb0 con 0x7f8a400d9a80 2024-04-25T02:06:14.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.450 7f8a36ffd700 1 -- 172.21.15.57:0/2822764272 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8a28005a10 con 0x7f8a400d9a80 2024-04-25T02:06:14.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.450 7f8a36ffd700 1 -- 172.21.15.57:0/2822764272 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8a280148d0 con 0x7f8a400d9a80 2024-04-25T02:06:14.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.451 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a400f08e0 con 0x7f8a400d9a80 2024-04-25T02:06:14.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.454 7f8a36ffd700 1 -- 172.21.15.57:0/2822764272 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f8a280070d0 con 0x7f8a400d9a80 2024-04-25T02:06:14.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.598 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr"]} v 0) v1 -- 0x7f8a401aee50 con 0x7f8a400d9a80 2024-04-25T02:06:14.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.759 7f8a36ffd700 1 -- 172.21.15.57:0/2822764272 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr"]}]=0 v38) v1 ==== 139+0+0 (secure 0 0 0) 0x7f8a28000c30 con 0x7f8a400d9a80 2024-04-25T02:06:14.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.760 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 >> v1:172.21.15.57:6816/43033 conn(0x7f8a240145b0 legacy=0x7f8a24016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.760 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a400d9a80 msgr2=0x7f8a400d9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.760 7f8a44fa5700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a400d9a80 0x7f8a400d9ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8a400c1a60 tx=0x7f8a2800c810).stop 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.760 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 shutdown_connections 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.760 7f8a44fa5700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a401b4d60 0x7f8a401b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.760 7f8a44fa5700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a400d9a80 0x7f8a400d9ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.761 7f8a44fa5700 1 --2- 172.21.15.57:0/2822764272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a400da500 0x7f8a401b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.761 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 >> 172.21.15.57:0/2822764272 conn(0x7f8a400c2f70 msgr2=0x7f8a400d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.761 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 shutdown_connections 2024-04-25T02:06:14.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.761 7f8a44fa5700 1 -- 172.21.15.57:0/2822764272 wait complete. 2024-04-25T02:06:14.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T02:06:14.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.905 7fed2886f700 1 Processor -- start 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed2886f700 1 -- start start 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed2886f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed240f2010 0x7fed241a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed2886f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed241a8c00 0x7fed241ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed2886f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed240f91b0 con 0x7fed240f58a0 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed2886f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed240f2460 con 0x7fed240f2010 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed2886f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed241ac6a0 con 0x7fed241a8c00 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed20dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed240f2010 0x7fed241a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed215fb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fed240f58a0 0x7fed240f1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52070/0 (socket says 172.21.15.57:52070) 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed21dfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed241a8c00 0x7fed241ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed20dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed240f2010 0x7fed241a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36824/0 (socket says 172.21.15.57:36824) 2024-04-25T02:06:14.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.906 7fed215fb700 1 -- 172.21.15.57:0/3879549537 learned_addr learned my addr 172.21.15.57:0/3879549537 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed1bfff700 1 -- 172.21.15.57:0/3879549537 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092232035 0 0) 0x7fed0c001110 con 0x7fed240f58a0 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed21dfc700 1 -- 172.21.15.57:0/3879549537 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed240f2010 msgr2=0x7fed241a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed21dfc700 1 --2- 172.21.15.57:0/3879549537 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed240f2010 0x7fed241a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed21dfc700 1 -- 172.21.15.57:0/3879549537 >> v1:172.21.15.57:6789/0 conn(0x7fed240f58a0 legacy=0x7fed240f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed21dfc700 1 -- 172.21.15.57:0/3879549537 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed241ac850 con 0x7fed241a8c00 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed20dfa700 1 --2- 172.21.15.57:0/3879549537 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed240f2010 0x7fed241a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed21dfc700 1 --2- 172.21.15.57:0/3879549537 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed241a8c00 0x7fed241ab060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fed1c0032f0 tx=0x7fed1c009cc0).ready entity=mon.2 client_cookie=12c960b87ab4b3c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed1bfff700 1 -- 172.21.15.57:0/3879549537 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed241ac850 con 0x7fed241a8c00 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed1bfff700 1 -- 172.21.15.57:0/3879549537 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c00b880 con 0x7fed241a8c00 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed1bfff700 1 -- 172.21.15.57:0/3879549537 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed1c00ba60 con 0x7fed241a8c00 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed2886f700 1 -- 172.21.15.57:0/3879549537 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed241a8c00 msgr2=0x7fed241ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.907 7fed2886f700 1 --2- 172.21.15.57:0/3879549537 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed241a8c00 0x7fed241ab060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fed1c0032f0 tx=0x7fed1c009cc0).stop 2024-04-25T02:06:14.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.908 7fed2886f700 1 -- 172.21.15.57:0/3879549537 shutdown_connections 2024-04-25T02:06:14.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.908 7fed2886f700 1 --2- 172.21.15.57:0/3879549537 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed241a8c00 0x7fed241ab060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.908 7fed2886f700 1 --2- 172.21.15.57:0/3879549537 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed240f2010 0x7fed241a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.908 7fed2886f700 1 -- 172.21.15.57:0/3879549537 >> 172.21.15.57:0/3879549537 conn(0x7fed241139f0 msgr2=0x7fed240f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:14.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.908 7fed2886f700 1 -- 172.21.15.57:0/3879549537 shutdown_connections 2024-04-25T02:06:14.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.908 7fed2886f700 1 -- 172.21.15.57:0/3879549537 wait complete. 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed2886f700 1 Processor -- start 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed2886f700 1 -- start start 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed2886f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed240bbde0 0x7fed241b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed2886f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed241b6670 0x7fed241b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed2886f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed241b9100 0x7fed241bb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed2886f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed241b58d0 con 0x7fed241b9100 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed2886f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed240bb9c0 con 0x7fed241b6670 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed2886f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed241bbb90 con 0x7fed240bbde0 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed215fb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed240bbde0 0x7fed241b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed20dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed241b6670 0x7fed241b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed215fb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed240bbde0 0x7fed241b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33394/0 (socket says 172.21.15.57:33394) 2024-04-25T02:06:14.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed20dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed241b6670 0x7fed241b8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36840/0 (socket says 172.21.15.57:36840) 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed21dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed241b9100 0x7fed241bb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed215fb700 1 -- 172.21.15.57:0/1518001180 learned_addr learned my addr 172.21.15.57:0/1518001180 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed215fb700 1 -- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed241b6670 msgr2=0x7fed241b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed215fb700 1 --2- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed241b6670 0x7fed241b8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed215fb700 1 -- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed241b9100 msgr2=0x7fed241bb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed215fb700 1 --2- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed241b9100 0x7fed241bb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed215fb700 1 -- 172.21.15.57:0/1518001180 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed241bbd40 con 0x7fed240bbde0 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.932 7fed20dfa700 1 --2- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed241b6670 0x7fed241b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.933 7fed215fb700 1 --2- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed240bbde0 0x7fed241b6040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fed240cb6f0 tx=0x7fed0c00c7e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.933 7fed1a7fc700 1 -- 172.21.15.57:0/1518001180 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed241bbd40 con 0x7fed240bbde0 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.933 7fed1a7fc700 1 -- 172.21.15.57:0/1518001180 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c0072e0 con 0x7fed240bbde0 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.933 7fed2886f700 1 -- 172.21.15.57:0/1518001180 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed241bbf40 con 0x7fed240bbde0 2024-04-25T02:06:14.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.933 7fed1a7fc700 1 -- 172.21.15.57:0/1518001180 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed0c005810 con 0x7fed240bbde0 2024-04-25T02:06:14.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.933 7fed2886f700 1 -- 172.21.15.57:0/1518001180 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed241bc320 con 0x7fed240bbde0 2024-04-25T02:06:14.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.933 7fed1a7fc700 1 -- 172.21.15.57:0/1518001180 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fed0c005a10 con 0x7fed240bbde0 2024-04-25T02:06:14.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.933 7fed1a7fc700 1 -- 172.21.15.57:0/1518001180 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fed0c0148d0 con 0x7fed240bbde0 2024-04-25T02:06:14.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.934 7fed2886f700 1 -- 172.21.15.57:0/1518001180 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed240f0860 con 0x7fed240bbde0 2024-04-25T02:06:14.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:14.937 7fed1a7fc700 1 -- 172.21.15.57:0/1518001180 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fed0c0070d0 con 0x7fed240bbde0 2024-04-25T02:06:15.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.049 7fed2886f700 1 -- 172.21.15.57:0/1518001180 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fed240d6290 con 0x7fed240bbde0 2024-04-25T02:06:15.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.054 7fed1a7fc700 1 -- 172.21.15.57:0/1518001180 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed0c000c30 con 0x7fed240bbde0 2024-04-25T02:06:15.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 -- 172.21.15.57:0/1518001180 >> v1:172.21.15.57:6816/43033 conn(0x7fed080145b0 legacy=0x7fed08016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 -- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed240bbde0 msgr2=0x7fed241b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 --2- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed240bbde0 0x7fed241b6040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fed240cb6f0 tx=0x7fed0c00c7e0).stop 2024-04-25T02:06:15.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 -- 172.21.15.57:0/1518001180 shutdown_connections 2024-04-25T02:06:15.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 --2- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed241b9100 0x7fed241bb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 --2- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fed240bbde0 0x7fed241b6040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 --2- 172.21.15.57:0/1518001180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fed241b6670 0x7fed241b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 -- 172.21.15.57:0/1518001180 >> 172.21.15.57:0/1518001180 conn(0x7fed240dc7e0 msgr2=0x7fed240c1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:15.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 -- 172.21.15.57:0/1518001180 shutdown_connections 2024-04-25T02:06:15.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.055 7fed2886f700 1 -- 172.21.15.57:0/1518001180 wait complete. 2024-04-25T02:06:15.073 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:06:15.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:06:15.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:06:15.239 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:06:15.239 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:06:15.239 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:15.285 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:06:15.285 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:15.370 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:06:15.370 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:15.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:15.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f40ab0700 1 Processor -- start 2024-04-25T02:06:15.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f40ab0700 1 -- start start 2024-04-25T02:06:15.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f40ab0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c10b910 0x7f0f3c1a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f40ab0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f3c1a59d0 0x7f0f3c1a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f40ab0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c10bd60 con 0x7f0f3c0f5a10 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f40ab0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0fa590 con 0x7f0f3c1a59d0 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f40ab0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1a0c50 con 0x7f0f3c10b910 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f3a051700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f3c1a59d0 0x7f0f3c1a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.582 7f0f3104f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c10b910 0x7f0f3c1a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3104f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c10b910 0x7f0f3c1a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36842/0 (socket says 172.21.15.57:36842) 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3104f700 1 -- 172.21.15.57:0/105252662 learned_addr learned my addr 172.21.15.57:0/105252662 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3a051700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f3c1a59d0 0x7f0f3c1a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60338/0 (socket says 172.21.15.57:60338) 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3104f700 1 -- 172.21.15.57:0/105252662 >> v2:172.21.15.57:3300/0 conn(0x7f0f3c1a59d0 msgr2=0x7f0f3c1a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3104f700 1 --2- 172.21.15.57:0/105252662 >> v2:172.21.15.57:3300/0 conn(0x7f0f3c1a59d0 0x7f0f3c1a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3104f700 1 -- 172.21.15.57:0/105252662 >> v1:172.21.15.57:6789/0 conn(0x7f0f3c0f5a10 legacy=0x7f0f3c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3104f700 1 -- 172.21.15.57:0/105252662 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c1a9470 con 0x7f0f3c10b910 2024-04-25T02:06:15.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3904f700 1 -- 172.21.15.57:0/105252662 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827528409 0 0) 0x7f0f2c001110 con 0x7f0f3c0f5a10 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3a051700 1 --2- 172.21.15.57:0/105252662 >> v2:172.21.15.57:3300/0 conn(0x7f0f3c1a59d0 0x7f0f3c1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3104f700 1 --2- 172.21.15.57:0/105252662 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c10b910 0x7f0f3c1a53a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0f3c103a10 tx=0x7f0f2400bc30).ready entity=mon.1 client_cookie=68112bdcde6a363a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3904f700 1 -- 172.21.15.57:0/105252662 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f3c1a9470 con 0x7f0f3c10b910 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3904f700 1 -- 172.21.15.57:0/105252662 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2400dc40 con 0x7f0f3c10b910 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f3904f700 1 -- 172.21.15.57:0/105252662 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f24010660 con 0x7f0f3c10b910 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f40ab0700 1 -- 172.21.15.57:0/105252662 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c10b910 msgr2=0x7f0f3c1a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.583 7f0f40ab0700 1 --2- 172.21.15.57:0/105252662 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c10b910 0x7f0f3c1a53a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0f3c103a10 tx=0x7f0f2400bc30).stop 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.584 7f0f40ab0700 1 -- 172.21.15.57:0/105252662 shutdown_connections 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.584 7f0f40ab0700 1 --2- 172.21.15.57:0/105252662 >> v2:172.21.15.57:3300/0 conn(0x7f0f3c1a59d0 0x7f0f3c1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.584 7f0f40ab0700 1 --2- 172.21.15.57:0/105252662 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c10b910 0x7f0f3c1a53a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.584 7f0f40ab0700 1 -- 172.21.15.57:0/105252662 >> 172.21.15.57:0/105252662 conn(0x7f0f3c113a70 msgr2=0x7f0f3c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.584 7f0f40ab0700 1 -- 172.21.15.57:0/105252662 shutdown_connections 2024-04-25T02:06:15.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.584 7f0f40ab0700 1 -- 172.21.15.57:0/105252662 wait complete. 2024-04-25T02:06:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.608 7f0f40ab0700 1 Processor -- start 2024-04-25T02:06:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.608 7f0f40ab0700 1 -- start start 2024-04-25T02:06:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f40ab0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0f3c0d7000 0x7f0f3c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f40ab0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3c0cea20 0x7f0f3c1b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f40ab0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c0cee70 0x7f0f3c1b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f40ab0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0f50e0 con 0x7f0f3c0cea20 2024-04-25T02:06:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f40ab0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1b0e30 con 0x7f0f3c0cee70 2024-04-25T02:06:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f40ab0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1b1060 con 0x7f0f3c0d7000 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3104f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3c0cea20 0x7f0f3c1b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3a051700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c0cee70 0x7f0f3c1b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3a051700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c0cee70 0x7f0f3c1b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36846/0 (socket says 172.21.15.57:36846) 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3a051700 1 -- 172.21.15.57:0/3874851466 learned_addr learned my addr 172.21.15.57:0/3874851466 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f39850700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0f3c0d7000 0x7f0f3c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3104f700 1 -- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0f3c0d7000 msgr2=0x7f0f3c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3104f700 1 --2- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0f3c0d7000 0x7f0f3c0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3104f700 1 -- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c0cee70 msgr2=0x7f0f3c1b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3104f700 1 --2- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c0cee70 0x7f0f3c1b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3104f700 1 -- 172.21.15.57:0/3874851466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c1b78c0 con 0x7f0f3c0cea20 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3a051700 1 --2- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c0cee70 0x7f0f3c1b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f3104f700 1 --2- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3c0cea20 0x7f0f3c1b01d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0f3c103a10 tx=0x7f0f24006cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f337fe700 1 -- 172.21.15.57:0/3874851466 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f3c1b78c0 con 0x7f0f3c0cea20 2024-04-25T02:06:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f337fe700 1 -- 172.21.15.57:0/3874851466 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24010c60 con 0x7f0f3c0cea20 2024-04-25T02:06:15.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c1b7ac0 con 0x7f0f3c0cea20 2024-04-25T02:06:15.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.609 7f0f337fe700 1 -- 172.21.15.57:0/3874851466 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0f24024640 con 0x7f0f3c0cea20 2024-04-25T02:06:15.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.610 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c1b7ea0 con 0x7f0f3c0cea20 2024-04-25T02:06:15.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.610 7f0f337fe700 1 -- 172.21.15.57:0/3874851466 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0f24024840 con 0x7f0f3c0cea20 2024-04-25T02:06:15.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.610 7f0f337fe700 1 -- 172.21.15.57:0/3874851466 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f0f24001000 con 0x7f0f3c0cea20 2024-04-25T02:06:15.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.611 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c0f08e0 con 0x7f0f3c0cea20 2024-04-25T02:06:15.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.614 7f0f337fe700 1 -- 172.21.15.57:0/3874851466 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f0f24010a50 con 0x7f0f3c0cea20 2024-04-25T02:06:15.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.726 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f3c1aa8f0 con 0x7f0f3c0cea20 2024-04-25T02:06:15.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.727 7f0f337fe700 1 -- 172.21.15.57:0/3874851466 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f0f2400d840 con 0x7f0f3c0cea20 2024-04-25T02:06:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:15.734 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:15.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 >> v1:172.21.15.57:6816/43033 conn(0x7f0f200145b0 legacy=0x7f0f20016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3c0cea20 msgr2=0x7f0f3c1b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 --2- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3c0cea20 0x7f0f3c1b01d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0f3c103a10 tx=0x7f0f24006cd0).stop 2024-04-25T02:06:15.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 shutdown_connections 2024-04-25T02:06:15.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 --2- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f3c0cee70 0x7f0f3c1b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 --2- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0f3c0d7000 0x7f0f3c0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 --2- 172.21.15.57:0/3874851466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f3c0cea20 0x7f0f3c1b01d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 >> 172.21.15.57:0/3874851466 conn(0x7f0f3c0c4b20 msgr2=0x7f0f3c0e06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:15.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 shutdown_connections 2024-04-25T02:06:15.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.728 7f0f40ab0700 1 -- 172.21.15.57:0/3874851466 wait complete. 2024-04-25T02:06:15.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:15.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:15.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.874 7f880a78f700 1 Processor -- start 2024-04-25T02:06:15.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.874 7f880a78f700 1 -- start start 2024-04-25T02:06:15.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f880a78f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040f58a0 0x7f88040f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f880a78f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040f1e40 0x7f880410e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f880a78f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88040f2290 0x7f880410e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f880a78f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88040f91b0 con 0x7f88040f2290 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f880a78f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880410ee90 con 0x7f88040f58a0 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f880a78f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88041aa5e0 con 0x7f88040f1e40 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f87fabaf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040f1e40 0x7f880410e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f8803bb1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88040f2290 0x7f880410e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f88033b0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040f58a0 0x7f88040f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f8803bb1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88040f2290 0x7f880410e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60352/0 (socket says 172.21.15.57:60352) 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f87fabaf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040f1e40 0x7f880410e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33418/0 (socket says 172.21.15.57:33418) 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f8803bb1700 1 -- 172.21.15.57:0/3741681490 learned_addr learned my addr 172.21.15.57:0/3741681490 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f8803bb1700 1 -- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040f1e40 msgr2=0x7f880410e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f8803bb1700 1 --2- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040f1e40 0x7f880410e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f8803bb1700 1 -- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040f58a0 msgr2=0x7f88040f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:15.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f8803bb1700 1 --2- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040f58a0 0x7f88040f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f8803bb1700 1 -- 172.21.15.57:0/3741681490 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88041aa790 con 0x7f88040f2290 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.875 7f88033b0700 1 --2- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040f58a0 0x7f88040f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f8803bb1700 1 --2- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88040f2290 0x7f880410e860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f87fc0032f0 tx=0x7f87fc009de0).ready entity=mon.0 client_cookie=fb4d0d4592143a7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f8802baf700 1 -- 172.21.15.57:0/3741681490 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88041aa790 con 0x7f88040f2290 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f8802baf700 1 -- 172.21.15.57:0/3741681490 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00b870 con 0x7f88040f2290 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f8802baf700 1 -- 172.21.15.57:0/3741681490 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87fc00ba50 con 0x7f88040f2290 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 -- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88040f2290 msgr2=0x7f880410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 --2- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88040f2290 0x7f880410e860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f87fc0032f0 tx=0x7f87fc009de0).stop 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 -- 172.21.15.57:0/3741681490 shutdown_connections 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 --2- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88040f2290 0x7f880410e860 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 --2- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040f58a0 0x7f88040f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 --2- 172.21.15.57:0/3741681490 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040f1e40 0x7f880410e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 -- 172.21.15.57:0/3741681490 >> 172.21.15.57:0/3741681490 conn(0x7f88041139f0 msgr2=0x7f88040f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 -- 172.21.15.57:0/3741681490 shutdown_connections 2024-04-25T02:06:15.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.876 7f880a78f700 1 -- 172.21.15.57:0/3741681490 wait complete. 2024-04-25T02:06:15.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.900 7f880a78f700 1 Processor -- start 2024-04-25T02:06:15.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.900 7f880a78f700 1 -- start start 2024-04-25T02:06:15.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f880a78f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040d3670 0x7f88040d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f880a78f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040d40f0 0x7f88041b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f880a78f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88041b4570 0x7f88041b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:15.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f880a78f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88040bdd90 con 0x7f88041b4570 2024-04-25T02:06:15.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f880a78f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88041b4ff0 con 0x7f88040d3670 2024-04-25T02:06:15.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f880a78f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88040be1f0 con 0x7f88040d40f0 2024-04-25T02:06:15.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f88033b0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040d3670 0x7f88040d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040d40f0 0x7f88041b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040d40f0 0x7f88041b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:33434/0 (socket says 172.21.15.57:33434) 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f88033b0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040d3670 0x7f88040d3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:36858/0 (socket says 172.21.15.57:36858) 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 -- 172.21.15.57:0/3298161285 learned_addr learned my addr 172.21.15.57:0/3298161285 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f8803bb1700 1 --2- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88041b4570 0x7f88041b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 -- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040d3670 msgr2=0x7f88040d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 --2- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040d3670 0x7f88040d3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 -- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88041b4570 msgr2=0x7f88041b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 --2- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88041b4570 0x7f88041b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 -- 172.21.15.57:0/3298161285 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040e0a20 con 0x7f88040d40f0 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f87fabaf700 1 --2- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040d40f0 0x7f88041b3f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f88040e00e0 tx=0x7f87ec00ebe0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f88013ac700 1 -- 172.21.15.57:0/3298161285 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88040e0a20 con 0x7f88040d40f0 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f88013ac700 1 -- 172.21.15.57:0/3298161285 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec00c870 con 0x7f88040d40f0 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f880a78f700 1 -- 172.21.15.57:0/3298161285 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88040bda00 con 0x7f88040d40f0 2024-04-25T02:06:15.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.901 7f88013ac700 1 -- 172.21.15.57:0/3298161285 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87ec00f040 con 0x7f88040d40f0 2024-04-25T02:06:15.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.902 7f880a78f700 1 -- 172.21.15.57:0/3298161285 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88041bb7d0 con 0x7f88040d40f0 2024-04-25T02:06:15.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.902 7f88013ac700 1 -- 172.21.15.57:0/3298161285 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f87ec011070 con 0x7f88040d40f0 2024-04-25T02:06:15.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.902 7f88013ac700 1 -- 172.21.15.57:0/3298161285 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f87ec010040 con 0x7f88040d40f0 2024-04-25T02:06:15.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.902 7f880a78f700 1 -- 172.21.15.57:0/3298161285 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88040f0860 con 0x7f88040d40f0 2024-04-25T02:06:15.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:15.906 7f88013ac700 1 -- 172.21.15.57:0/3298161285 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f87ec00c470 con 0x7f88040d40f0 2024-04-25T02:06:16.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.016 7f880a78f700 1 -- 172.21.15.57:0/3298161285 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88041ae7d0 con 0x7f88040d40f0 2024-04-25T02:06:16.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.016 7f88013ac700 1 -- 172.21.15.57:0/3298161285 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87ec000c30 con 0x7f88040d40f0 2024-04-25T02:06:16.023 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:16.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.017 7f880a78f700 1 -- 172.21.15.57:0/3298161285 >> v1:172.21.15.57:6816/43033 conn(0x7f87e80145b0 legacy=0x7f87e8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.017 7f880a78f700 1 -- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040d40f0 msgr2=0x7f88041b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.017 7f880a78f700 1 --2- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040d40f0 0x7f88041b3f40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f88040e00e0 tx=0x7f87ec00ebe0).stop 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.018 7f880a78f700 1 -- 172.21.15.57:0/3298161285 shutdown_connections 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.018 7f880a78f700 1 --2- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88041b4570 0x7f88041b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.018 7f880a78f700 1 --2- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88040d3670 0x7f88040d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.018 7f880a78f700 1 --2- 172.21.15.57:0/3298161285 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88040d40f0 0x7f88041b3f40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.018 7f880a78f700 1 -- 172.21.15.57:0/3298161285 >> 172.21.15.57:0/3298161285 conn(0x7f88040c59b0 msgr2=0x7f88040c2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.018 7f880a78f700 1 -- 172.21.15.57:0/3298161285 shutdown_connections 2024-04-25T02:06:16.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.018 7f880a78f700 1 -- 172.21.15.57:0/3298161285 wait complete. 2024-04-25T02:06:16.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:16.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.162 7f6288026700 1 Processor -- start 2024-04-25T02:06:16.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.162 7f6288026700 1 -- start start 2024-04-25T02:06:16.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6288026700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62800f5990 0x7f628010b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6288026700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f628010bb10 0x7f62801a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6288026700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62801a09f0 con 0x7f628010b6c0 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6288026700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62800fa510 con 0x7f62800f5990 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6288026700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62801a0c10 con 0x7f628010bb10 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6284e21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62800f5990 0x7f628010b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6285622700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f628010bb10 0x7f62801a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6284e21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62800f5990 0x7f628010b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60364/0 (socket says 172.21.15.57:60364) 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6284e21700 1 -- 172.21.15.57:0/3150494697 learned_addr learned my addr 172.21.15.57:0/3150494697 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6284e21700 1 -- 172.21.15.57:0/3150494697 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f628010bb10 msgr2=0x7f62801a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6284e21700 1 --2- 172.21.15.57:0/3150494697 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f628010bb10 0x7f62801a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6284e21700 1 -- 172.21.15.57:0/3150494697 >> v1:172.21.15.57:6789/0 conn(0x7f628010b6c0 legacy=0x7f628019fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6284e21700 1 -- 172.21.15.57:0/3150494697 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62801a9350 con 0x7f62800f5990 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f627f7fe700 1 -- 172.21.15.57:0/3150494697 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544977368 0 0) 0x7f626c001110 con 0x7f628010b6c0 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6285622700 1 --2- 172.21.15.57:0/3150494697 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f628010bb10 0x7f62801a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.163 7f6284e21700 1 --2- 172.21.15.57:0/3150494697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800f5990 0x7f628010b090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6280103990 tx=0x7f6274009a80).ready entity=mon.0 client_cookie=2fe1f6ef78aea425 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f627f7fe700 1 -- 172.21.15.57:0/3150494697 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62801a9350 con 0x7f62800f5990 2024-04-25T02:06:16.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f627f7fe700 1 -- 172.21.15.57:0/3150494697 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627400f510 con 0x7f62800f5990 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f627f7fe700 1 -- 172.21.15.57:0/3150494697 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f627400f6f0 con 0x7f62800f5990 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f6288026700 1 -- 172.21.15.57:0/3150494697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800f5990 msgr2=0x7f628010b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f6288026700 1 --2- 172.21.15.57:0/3150494697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800f5990 0x7f628010b090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6280103990 tx=0x7f6274009a80).stop 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f6288026700 1 -- 172.21.15.57:0/3150494697 shutdown_connections 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f6288026700 1 --2- 172.21.15.57:0/3150494697 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f628010bb10 0x7f62801a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f6288026700 1 --2- 172.21.15.57:0/3150494697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800f5990 0x7f628010b090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f6288026700 1 -- 172.21.15.57:0/3150494697 >> 172.21.15.57:0/3150494697 conn(0x7f62801139f0 msgr2=0x7f62800f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f6288026700 1 -- 172.21.15.57:0/3150494697 shutdown_connections 2024-04-25T02:06:16.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.164 7f6288026700 1 -- 172.21.15.57:0/3150494697 wait complete. 2024-04-25T02:06:16.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.188 7f6288026700 1 Processor -- start 2024-04-25T02:06:16.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.188 7f6288026700 1 -- start start 2024-04-25T02:06:16.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6288026700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800c8990 0x7f62800d6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6288026700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62800d66b0 0x7f62800cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6288026700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62800d6b00 0x7f62800cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6288026700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62800c46b0 con 0x7f62800c8990 2024-04-25T02:06:16.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6288026700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62800cc6d0 con 0x7f62800d6b00 2024-04-25T02:06:16.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6288026700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62800cc880 con 0x7f62800d66b0 2024-04-25T02:06:16.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6284e21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800c8990 0x7f62800d6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6284e21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800c8990 0x7f62800d6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50876/0 (socket says 172.21.15.57:50876) 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6284e21700 1 -- 172.21.15.57:0/3163261613 learned_addr learned my addr 172.21.15.57:0/3163261613 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6285622700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62800d6b00 0x7f62800cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f627ffff700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62800d66b0 0x7f62800cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6284e21700 1 -- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62800d66b0 msgr2=0x7f62800cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6284e21700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62800d66b0 0x7f62800cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6284e21700 1 -- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62800d6b00 msgr2=0x7f62800cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6284e21700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62800d6b00 0x7f62800cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6284e21700 1 -- 172.21.15.57:0/3163261613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62800f1810 con 0x7f62800c8990 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.189 7f6285622700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62800d6b00 0x7f62800cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.190 7f6284e21700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800c8990 0x7f62800d6080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f62740030b0 tx=0x7f62740068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.190 7f627dffb700 1 -- 172.21.15.57:0/3163261613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62800f1810 con 0x7f62800c8990 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.190 7f627dffb700 1 -- 172.21.15.57:0/3163261613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62740116d0 con 0x7f62800c8990 2024-04-25T02:06:16.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.190 7f627dffb700 1 -- 172.21.15.57:0/3163261613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6274011aa0 con 0x7f62800c8990 2024-04-25T02:06:16.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.190 7f6288026700 1 -- 172.21.15.57:0/3163261613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62800f1a70 con 0x7f62800c8990 2024-04-25T02:06:16.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.190 7f6288026700 1 -- 172.21.15.57:0/3163261613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62800f1f70 con 0x7f62800c8990 2024-04-25T02:06:16.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.190 7f627dffb700 1 -- 172.21.15.57:0/3163261613 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6274019030 con 0x7f62800c8990 2024-04-25T02:06:16.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.190 7f627dffb700 1 -- 172.21.15.57:0/3163261613 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f6274018040 con 0x7f62800c8990 2024-04-25T02:06:16.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.191 7f6288026700 1 -- 172.21.15.57:0/3163261613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62800f0860 con 0x7f62800c8990 2024-04-25T02:06:16.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.194 7f627dffb700 1 -- 172.21.15.57:0/3163261613 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f62740114c0 con 0x7f62800c8990 2024-04-25T02:06:16.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.306 7f6288026700 1 -- 172.21.15.57:0/3163261613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62801ab3b0 con 0x7f62800c8990 2024-04-25T02:06:16.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.306 7f627dffb700 1 -- 172.21.15.57:0/3163261613 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f627400f300 con 0x7f62800c8990 2024-04-25T02:06:16.313 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.307 7f6288026700 1 -- 172.21.15.57:0/3163261613 >> v1:172.21.15.57:6816/43033 conn(0x7f62680145b0 legacy=0x7f6268016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.307 7f6288026700 1 -- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800c8990 msgr2=0x7f62800d6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.307 7f6288026700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800c8990 0x7f62800d6080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f62740030b0 tx=0x7f62740068c0).stop 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.308 7f6288026700 1 -- 172.21.15.57:0/3163261613 shutdown_connections 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.308 7f6288026700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62800d6b00 0x7f62800cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.308 7f6288026700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62800c8990 0x7f62800d6080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.308 7f6288026700 1 --2- 172.21.15.57:0/3163261613 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62800d66b0 0x7f62800cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.308 7f6288026700 1 -- 172.21.15.57:0/3163261613 >> 172.21.15.57:0/3163261613 conn(0x7f62800c5710 msgr2=0x7f62800cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.308 7f6288026700 1 -- 172.21.15.57:0/3163261613 shutdown_connections 2024-04-25T02:06:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.308 7f6288026700 1 -- 172.21.15.57:0/3163261613 wait complete. 2024-04-25T02:06:16.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:16.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.452 7f687d2ce700 1 Processor -- start 2024-04-25T02:06:16.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.452 7f687d2ce700 1 -- start start 2024-04-25T02:06:16.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687d2ce700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f687810b910 0x7f68781a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687d2ce700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781a59d0 0x7f68781a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687d2ce700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687810bd60 con 0x7f68780f5a10 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687d2ce700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780fa590 con 0x7f687810b910 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687d2ce700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68781a0c50 con 0x7f68781a59d0 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687685d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781a59d0 0x7f68781a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f686ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f687810b910 0x7f68781a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687605c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f68780f5a10 0x7f687810b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47294/0 (socket says 172.21.15.57:47294) 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f686ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f687810b910 0x7f68781a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49740/0 (socket says 172.21.15.57:49740) 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687605c700 1 -- 172.21.15.57:0/2478918687 learned_addr learned my addr 172.21.15.57:0/2478918687 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687685d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781a59d0 0x7f68781a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50410/0 (socket says 172.21.15.57:50410) 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f687585b700 1 -- 172.21.15.57:0/2478918687 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485222412 0 0) 0x7f6868001110 con 0x7f68780f5a10 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.453 7f686ffff700 1 -- 172.21.15.57:0/2478918687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781a59d0 msgr2=0x7f68781a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f686ffff700 1 --2- 172.21.15.57:0/2478918687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781a59d0 0x7f68781a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f686ffff700 1 -- 172.21.15.57:0/2478918687 >> v1:172.21.15.57:6789/0 conn(0x7f68780f5a10 legacy=0x7f687810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f686ffff700 1 -- 172.21.15.57:0/2478918687 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780f1890 con 0x7f687810b910 2024-04-25T02:06:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f687685d700 1 --2- 172.21.15.57:0/2478918687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781a59d0 0x7f68781a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f686ffff700 1 --2- 172.21.15.57:0/2478918687 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f687810b910 0x7f68781a53a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6878103a10 tx=0x7f686000ba50).ready entity=mon.1 client_cookie=1ce9324130206abe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f687585b700 1 -- 172.21.15.57:0/2478918687 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68780f1890 con 0x7f687810b910 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f687585b700 1 -- 172.21.15.57:0/2478918687 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000d570 con 0x7f687810b910 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f687585b700 1 -- 172.21.15.57:0/2478918687 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f686000d940 con 0x7f687810b910 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f687d2ce700 1 -- 172.21.15.57:0/2478918687 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f687810b910 msgr2=0x7f68781a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.454 7f687d2ce700 1 --2- 172.21.15.57:0/2478918687 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f687810b910 0x7f68781a53a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6878103a10 tx=0x7f686000ba50).stop 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.455 7f687d2ce700 1 -- 172.21.15.57:0/2478918687 shutdown_connections 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.455 7f687d2ce700 1 --2- 172.21.15.57:0/2478918687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781a59d0 0x7f68781a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.455 7f687d2ce700 1 --2- 172.21.15.57:0/2478918687 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f687810b910 0x7f68781a53a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.455 7f687d2ce700 1 -- 172.21.15.57:0/2478918687 >> 172.21.15.57:0/2478918687 conn(0x7f6878113a70 msgr2=0x7f68780f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.455 7f687d2ce700 1 -- 172.21.15.57:0/2478918687 shutdown_connections 2024-04-25T02:06:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.455 7f687d2ce700 1 -- 172.21.15.57:0/2478918687 wait complete. 2024-04-25T02:06:16.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687d2ce700 1 Processor -- start 2024-04-25T02:06:16.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687d2ce700 1 -- start start 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687d2ce700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68780db410 0x7f68781b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687d2ce700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68781b1b00 0x7f68781b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687d2ce700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781b1f50 0x7f68781b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687d2ce700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c4810 con 0x7f68780db410 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687d2ce700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780db9f0 con 0x7f68781b1b00 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687d2ce700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68780dbc20 con 0x7f68781b1f50 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687605c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68780db410 0x7f68781b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f686ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68781b1b00 0x7f68781b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687605c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68780db410 0x7f68781b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50884/0 (socket says 172.21.15.57:50884) 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687605c700 1 -- 172.21.15.57:0/1400785964 learned_addr learned my addr 172.21.15.57:0/1400785964 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.479 7f687685d700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781b1f50 0x7f68781b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f687605c700 1 -- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781b1f50 msgr2=0x7f68781b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f687605c700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781b1f50 0x7f68781b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f687605c700 1 -- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68781b1b00 msgr2=0x7f68781b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f687605c700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68781b1b00 0x7f68781b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f687605c700 1 -- 172.21.15.57:0/1400785964 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68781b5480 con 0x7f68780db410 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f686ffff700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68781b1b00 0x7f68781b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f687605c700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68780db410 0x7f68781b14d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f68780c3be0 tx=0x7f686800c860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f686f7fe700 1 -- 172.21.15.57:0/1400785964 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68781b5480 con 0x7f68780db410 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f686f7fe700 1 -- 172.21.15.57:0/1400785964 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680072e0 con 0x7f68780db410 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68781b57a0 con 0x7f68780db410 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f686f7fe700 1 -- 172.21.15.57:0/1400785964 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6868005810 con 0x7f68780db410 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68781bc0f0 con 0x7f68780db410 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.480 7f686f7fe700 1 -- 172.21.15.57:0/1400785964 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6868005a10 con 0x7f68780db410 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.481 7f686f7fe700 1 -- 172.21.15.57:0/1400785964 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f68680149e0 con 0x7f68780db410 2024-04-25T02:06:16.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.481 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68780f08e0 con 0x7f68780db410 2024-04-25T02:06:16.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.485 7f686f7fe700 1 -- 172.21.15.57:0/1400785964 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f68680070d0 con 0x7f68780db410 2024-04-25T02:06:16.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.597 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68780d2500 con 0x7f68780db410 2024-04-25T02:06:16.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.597 7f686f7fe700 1 -- 172.21.15.57:0/1400785964 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6868000c30 con 0x7f68780db410 2024-04-25T02:06:16.604 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.598 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 >> v1:172.21.15.57:6816/43033 conn(0x7f685c0145b0 legacy=0x7f685c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.598 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68780db410 msgr2=0x7f68781b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.598 7f687d2ce700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68780db410 0x7f68781b14d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f68780c3be0 tx=0x7f686800c860).stop 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.598 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 shutdown_connections 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.598 7f687d2ce700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68781b1f50 0x7f68781b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.598 7f687d2ce700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68780db410 0x7f68781b14d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.598 7f687d2ce700 1 --2- 172.21.15.57:0/1400785964 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68781b1b00 0x7f68781b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.598 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 >> 172.21.15.57:0/1400785964 conn(0x7f68780c0f30 msgr2=0x7f68780df830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.599 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 shutdown_connections 2024-04-25T02:06:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.599 7f687d2ce700 1 -- 172.21.15.57:0/1400785964 wait complete. 2024-04-25T02:06:16.616 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:06:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.741 7f5909aec700 1 Processor -- start 2024-04-25T02:06:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f5909aec700 1 -- start start 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f5909aec700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59040f2080 0x7f59041a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f5909aec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041a8c70 0x7f59041ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f5909aec700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59040f9220 con 0x7f59040f5910 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f5909aec700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59040f24d0 con 0x7f59040f2080 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f5909aec700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59041ac710 con 0x7f59041a8c70 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f58fa05c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59040f2080 0x7f59041a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f590285d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f59040f5910 0x7f59040f1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47302/0 (socket says 172.21.15.57:47302) 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f590285d700 1 -- 172.21.15.57:0/2389962470 learned_addr learned my addr 172.21.15.57:0/2389962470 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.742 7f590305e700 1 --2- 172.21.15.57:0/2389962470 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041a8c70 0x7f59041ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f58fa05c700 1 -- 172.21.15.57:0/2389962470 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041a8c70 msgr2=0x7f59041ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f58fa05c700 1 --2- 172.21.15.57:0/2389962470 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041a8c70 0x7f59041ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f58fa05c700 1 -- 172.21.15.57:0/2389962470 >> v1:172.21.15.57:6789/0 conn(0x7f59040f5910 legacy=0x7f59040f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f58fa05c700 1 -- 172.21.15.57:0/2389962470 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59041ac8c0 con 0x7f59040f2080 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f58fa05c700 1 --2- 172.21.15.57:0/2389962470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040f2080 0x7f59041a8640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f59041037e0 tx=0x7f58ec00ba20).ready entity=mon.0 client_cookie=3b481da68a0585bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f590205c700 1 -- 172.21.15.57:0/2389962470 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59041ac8c0 con 0x7f59040f2080 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f590205c700 1 -- 172.21.15.57:0/2389962470 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec00d5c0 con 0x7f59040f2080 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f590205c700 1 -- 172.21.15.57:0/2389962470 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58ec00d990 con 0x7f59040f2080 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f5909aec700 1 -- 172.21.15.57:0/2389962470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040f2080 msgr2=0x7f59041a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f5909aec700 1 --2- 172.21.15.57:0/2389962470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040f2080 0x7f59041a8640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f59041037e0 tx=0x7f58ec00ba20).stop 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f5909aec700 1 -- 172.21.15.57:0/2389962470 shutdown_connections 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f5909aec700 1 --2- 172.21.15.57:0/2389962470 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041a8c70 0x7f59041ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f5909aec700 1 --2- 172.21.15.57:0/2389962470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040f2080 0x7f59041a8640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f5909aec700 1 -- 172.21.15.57:0/2389962470 >> 172.21.15.57:0/2389962470 conn(0x7f5904113a60 msgr2=0x7f59040f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f5909aec700 1 -- 172.21.15.57:0/2389962470 shutdown_connections 2024-04-25T02:06:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.743 7f5909aec700 1 -- 172.21.15.57:0/2389962470 wait complete. 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f5909aec700 1 Processor -- start 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f5909aec700 1 -- start start 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f5909aec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59040d7380 0x7f59040d77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f5909aec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040d7e00 0x7f59041b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f5909aec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041b1f40 0x7f59041bc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f5909aec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59040bc730 con 0x7f59040d7e00 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f5909aec700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59040c3ae0 con 0x7f59041b1f40 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f5909aec700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59040c41c0 con 0x7f59040d7380 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f58fa05c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040d7e00 0x7f59041b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f58fa05c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040d7e00 0x7f59041b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50914/0 (socket says 172.21.15.57:50914) 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f58fa05c700 1 -- 172.21.15.57:0/1813136767 learned_addr learned my addr 172.21.15.57:0/1813136767 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:16.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f590285d700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59040d7380 0x7f59040d77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.768 7f590305e700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041b1f40 0x7f59041bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.769 7f58fa05c700 1 -- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59040d7380 msgr2=0x7f59040d77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.769 7f58fa05c700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59040d7380 0x7f59040d77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.769 7f58fa05c700 1 -- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041b1f40 msgr2=0x7f59041bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.769 7f58fa05c700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041b1f40 0x7f59041bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.769 7f58fa05c700 1 -- 172.21.15.57:0/1813136767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59040c4a60 con 0x7f59040d7e00 2024-04-25T02:06:16.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.769 7f58fa05c700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040d7e00 0x7f59041b1910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f59040c3c90 tx=0x7f58ec0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.773 7f5900859700 1 -- 172.21.15.57:0/1813136767 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59040c4a60 con 0x7f59040d7e00 2024-04-25T02:06:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.773 7f5900859700 1 -- 172.21.15.57:0/1813136767 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec011980 con 0x7f59040d7e00 2024-04-25T02:06:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.773 7f5909aec700 1 -- 172.21.15.57:0/1813136767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59041b2390 con 0x7f59040d7e00 2024-04-25T02:06:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.773 7f5900859700 1 -- 172.21.15.57:0/1813136767 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f58ec011d50 con 0x7f59040d7e00 2024-04-25T02:06:16.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.773 7f5909aec700 1 -- 172.21.15.57:0/1813136767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59041bc6c0 con 0x7f59040d7e00 2024-04-25T02:06:16.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.774 7f5900859700 1 -- 172.21.15.57:0/1813136767 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f58ec027460 con 0x7f59040d7e00 2024-04-25T02:06:16.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.774 7f5900859700 1 -- 172.21.15.57:0/1813136767 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f58ec020120 con 0x7f59040d7e00 2024-04-25T02:06:16.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.774 7f5909aec700 1 -- 172.21.15.57:0/1813136767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59040f08d0 con 0x7f59040d7e00 2024-04-25T02:06:16.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.778 7f5900859700 1 -- 172.21.15.57:0/1813136767 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f58ec00d3b0 con 0x7f59040d7e00 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.929 7f5909aec700 1 -- 172.21.15.57:0/1813136767 >> v1:172.21.15.57:6816/43033 conn(0x7f58e80145b0 legacy=0x7f58e8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 -- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040d7e00 msgr2=0x7f59041b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040d7e00 0x7f59041b1910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f59040c3c90 tx=0x7f58ec0068c0).stop 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 -- 172.21.15.57:0/1813136767 shutdown_connections 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59041b1f40 0x7f59041bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59040d7380 0x7f59040d77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 --2- 172.21.15.57:0/1813136767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040d7e00 0x7f59041b1910 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 -- 172.21.15.57:0/1813136767 >> 172.21.15.57:0/1813136767 conn(0x7f59040dc880 msgr2=0x7f59040bde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 -- 172.21.15.57:0/1813136767 shutdown_connections 2024-04-25T02:06:16.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:16.930 7f5909aec700 1 -- 172.21.15.57:0/1813136767 wait complete. 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:no valid command found; 10 closest matches: 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd perf 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd df {plain|tree} {class|name} {} 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd blocked-by 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool stats {} 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool scrub [...] 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool deep-scrub [...] 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool repair [...] 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool force-recovery [...] 2024-04-25T02:06:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool force-backfill [...] 2024-04-25T02:06:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool cancel-force-recovery [...] 2024-04-25T02:06:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: invalid command 2024-04-25T02:06:16.947 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T02:06:16.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dd6b37700 1 Processor -- start 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dd6b37700 1 -- start start 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dd6b37700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd00f5a00 0x7f7dd010b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dd6b37700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd010b730 0x7f7dd019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dd6b37700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd01a0a60 con 0x7f7dd010bb80 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dd6b37700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00fa580 con 0x7f7dd010b730 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dd6b37700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd01a0c80 con 0x7f7dd00f5a00 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dcf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd00f5a00 0x7f7dd010b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dcf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd00f5a00 0x7f7dd010b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50432/0 (socket says 172.21.15.57:50432) 2024-04-25T02:06:17.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dcf7fe700 1 -- 172.21.15.57:0/1704774238 learned_addr learned my addr 172.21.15.57:0/1704774238 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.073 7f7dceffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd010b730 0x7f7dd019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dceffd700 1 -- 172.21.15.57:0/1704774238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd00f5a00 msgr2=0x7f7dd010b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dceffd700 1 --2- 172.21.15.57:0/1704774238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd00f5a00 0x7f7dd010b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dceffd700 1 -- 172.21.15.57:0/1704774238 >> v1:172.21.15.57:6789/0 conn(0x7f7dd010bb80 legacy=0x7f7dd01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dceffd700 1 -- 172.21.15.57:0/1704774238 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd01a93c0 con 0x7f7dd010b730 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dce7fc700 1 -- 172.21.15.57:0/1704774238 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202185929 0 0) 0x7f7dc8001490 con 0x7f7dd010bb80 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dcf7fe700 1 --2- 172.21.15.57:0/1704774238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd00f5a00 0x7f7dd010b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dceffd700 1 --2- 172.21.15.57:0/1704774238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd010b730 0x7f7dd019fc30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7dd010c210 tx=0x7f7dc400ba50).ready entity=mon.1 client_cookie=97b30ed37a5aeac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dce7fc700 1 -- 172.21.15.57:0/1704774238 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7dd01a93c0 con 0x7f7dd010b730 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dce7fc700 1 -- 172.21.15.57:0/1704774238 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc400d570 con 0x7f7dd010b730 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dce7fc700 1 -- 172.21.15.57:0/1704774238 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7dc400d940 con 0x7f7dd010b730 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dd6b37700 1 -- 172.21.15.57:0/1704774238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd010b730 msgr2=0x7f7dd019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dd6b37700 1 --2- 172.21.15.57:0/1704774238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd010b730 0x7f7dd019fc30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7dd010c210 tx=0x7f7dc400ba50).stop 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dd6b37700 1 -- 172.21.15.57:0/1704774238 shutdown_connections 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dd6b37700 1 --2- 172.21.15.57:0/1704774238 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd00f5a00 0x7f7dd010b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dd6b37700 1 --2- 172.21.15.57:0/1704774238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd010b730 0x7f7dd019fc30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.074 7f7dd6b37700 1 -- 172.21.15.57:0/1704774238 >> 172.21.15.57:0/1704774238 conn(0x7f7dd0113a60 msgr2=0x7f7dd00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.075 7f7dd6b37700 1 -- 172.21.15.57:0/1704774238 shutdown_connections 2024-04-25T02:06:17.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.075 7f7dd6b37700 1 -- 172.21.15.57:0/1704774238 wait complete. 2024-04-25T02:06:17.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.098 7f7dd6b37700 1 Processor -- start 2024-04-25T02:06:17.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.098 7f7dd6b37700 1 -- start start 2024-04-25T02:06:17.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dd6b37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd00df890 0x7f7dd01a7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dd6b37700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd01a7770 0x7f7dd00cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dd6b37700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd01a7bc0 0x7f7dd00cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dd6b37700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00d1bb0 con 0x7f7dd00df890 2024-04-25T02:06:17.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dd6b37700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00cfa40 con 0x7f7dd01a7770 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dd6b37700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00cfc70 con 0x7f7dd01a7bc0 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dcf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd00df890 0x7f7dd01a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dceffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd01a7770 0x7f7dd00cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dcf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd00df890 0x7f7dd01a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50918/0 (socket says 172.21.15.57:50918) 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dcf7fe700 1 -- 172.21.15.57:0/2329042667 learned_addr learned my addr 172.21.15.57:0/2329042667 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dcffff700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd01a7bc0 0x7f7dd00cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dceffd700 1 -- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd01a7bc0 msgr2=0x7f7dd00cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dceffd700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd01a7bc0 0x7f7dd00cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dceffd700 1 -- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd00df890 msgr2=0x7f7dd01a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dceffd700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd00df890 0x7f7dd01a7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dceffd700 1 -- 172.21.15.57:0/2329042667 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd01bb810 con 0x7f7dd01a7770 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dcf7fe700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd00df890 0x7f7dd01a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:17.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.099 7f7dceffd700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd01a7770 0x7f7dd00cede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7dd00d30f0 tx=0x7f7dc40068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.100 7f7dccff9700 1 -- 172.21.15.57:0/2329042667 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7dd01bb810 con 0x7f7dd01a7770 2024-04-25T02:06:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.100 7f7dccff9700 1 -- 172.21.15.57:0/2329042667 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4011790 con 0x7f7dd01a7770 2024-04-25T02:06:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.100 7f7dccff9700 1 -- 172.21.15.57:0/2329042667 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7dc4017040 con 0x7f7dd01a7770 2024-04-25T02:06:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.100 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd01bba10 con 0x7f7dd01a7770 2024-04-25T02:06:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.100 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd01bbdf0 con 0x7f7dd01a7770 2024-04-25T02:06:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.100 7f7dccff9700 1 -- 172.21.15.57:0/2329042667 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7dc4011b60 con 0x7f7dd01a7770 2024-04-25T02:06:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.100 7f7dccff9700 1 -- 172.21.15.57:0/2329042667 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7dc4018070 con 0x7f7dd01a7770 2024-04-25T02:06:17.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.101 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd00f08d0 con 0x7f7dd01a7770 2024-04-25T02:06:17.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.104 7f7dccff9700 1 -- 172.21.15.57:0/2329042667 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7dc4011580 con 0x7f7dd01a7770 2024-04-25T02:06:17.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.229 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) v1 -- 0x7f7dd01ae820 con 0x7f7dd01a7770 2024-04-25T02:06:17.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.229 7f7dccff9700 1 -- 172.21.15.57:0/2329042667 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v17) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7dc400d360 con 0x7f7dd01a7770 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 >> v1:172.21.15.57:6816/43033 conn(0x7f7db00145b0 legacy=0x7f7db0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd01a7770 msgr2=0x7f7dd00cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd01a7770 0x7f7dd00cede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7dd00d30f0 tx=0x7f7dc40068c0).stop 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 shutdown_connections 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7dd01a7bc0 0x7f7dd00cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7dd00df890 0x7f7dd01a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 --2- 172.21.15.57:0/2329042667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7dd01a7770 0x7f7dd00cede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 >> 172.21.15.57:0/2329042667 conn(0x7f7dd00c4510 msgr2=0x7f7dd00cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 shutdown_connections 2024-04-25T02:06:17.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.231 7f7dd6b37700 1 -- 172.21.15.57:0/2329042667 wait complete. 2024-04-25T02:06:17.239 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-25T02:06:17.249 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:06:17.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:17.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T02:06:17.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2024-04-25T02:06:17.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:17.329 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:06:17.390 INFO:tasks.cephfs.cephfs_test_case:[] 2024-04-25T02:06:17.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:17.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.515 7fa3abcca700 1 Processor -- start 2024-04-25T02:06:17.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.515 7fa3abcca700 1 -- start start 2024-04-25T02:06:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3abcca700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a40f58a0 0x7fa3a40f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3abcca700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40f1e40 0x7fa3a410e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3abcca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa3a40f2290 0x7fa3a410e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3abcca700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40f91b0 con 0x7fa3a40f2290 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3abcca700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a410ee90 con 0x7fa3a40f1e40 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3abcca700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41aa5e0 con 0x7fa3a40f58a0 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a8ac5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a40f58a0 0x7fa3a40f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a92c6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa3a40f2290 0x7fa3a410e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa39bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40f1e40 0x7fa3a410e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a92c6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa3a40f2290 0x7fa3a410e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50928/0 (socket says 172.21.15.57:50928) 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a92c6700 1 -- 172.21.15.57:0/1139217028 learned_addr learned my addr 172.21.15.57:0/1139217028 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a8ac5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a40f58a0 0x7fa3a40f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50438/0 (socket says 172.21.15.57:50438) 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a92c6700 1 -- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a40f58a0 msgr2=0x7fa3a40f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a92c6700 1 --2- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a40f58a0 0x7fa3a40f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a92c6700 1 -- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40f1e40 msgr2=0x7fa3a410e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a92c6700 1 --2- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40f1e40 0x7fa3a410e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa3a92c6700 1 -- 172.21.15.57:0/1139217028 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a41aa790 con 0x7fa3a40f2290 2024-04-25T02:06:17.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.516 7fa39bfff700 1 --2- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40f1e40 0x7fa3a410e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa3a92c6700 1 --2- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a40f2290 0x7fa3a410e860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fa39c0032f0 tx=0x7fa39c009de0).ready entity=mon.0 client_cookie=765c6c07020090ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa39b7fe700 1 -- 172.21.15.57:0/1139217028 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3a41aa790 con 0x7fa3a40f2290 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa39b7fe700 1 -- 172.21.15.57:0/1139217028 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c00b870 con 0x7fa3a40f2290 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa39b7fe700 1 -- 172.21.15.57:0/1139217028 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa39c00ba50 con 0x7fa3a40f2290 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa3abcca700 1 -- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a40f2290 msgr2=0x7fa3a410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa3abcca700 1 --2- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a40f2290 0x7fa3a410e860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fa39c0032f0 tx=0x7fa39c009de0).stop 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa3abcca700 1 -- 172.21.15.57:0/1139217028 shutdown_connections 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa3abcca700 1 --2- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a40f2290 0x7fa3a410e860 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa3abcca700 1 --2- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a40f58a0 0x7fa3a40f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa3abcca700 1 --2- 172.21.15.57:0/1139217028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40f1e40 0x7fa3a410e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.517 7fa3abcca700 1 -- 172.21.15.57:0/1139217028 >> 172.21.15.57:0/1139217028 conn(0x7fa3a41139f0 msgr2=0x7fa3a40f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.518 7fa3abcca700 1 -- 172.21.15.57:0/1139217028 shutdown_connections 2024-04-25T02:06:17.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.518 7fa3abcca700 1 -- 172.21.15.57:0/1139217028 wait complete. 2024-04-25T02:06:17.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.541 7fa3abcca700 1 Processor -- start 2024-04-25T02:06:17.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3abcca700 1 -- start start 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3abcca700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40cc810 0x7fa3a40ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3abcca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a41b4410 0x7fa3a41b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3abcca700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a41b4e90 0x7fa3a41bb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3abcca700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40e2f60 con 0x7fa3a41b4410 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3abcca700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40da5a0 con 0x7fa3a40cc810 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3abcca700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41b52e0 con 0x7fa3a41b4e90 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3a8ac5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40cc810 0x7fa3a40ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3a92c6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a41b4e90 0x7fa3a41bb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa39bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a41b4410 0x7fa3a41b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3a8ac5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40cc810 0x7fa3a40ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49792/0 (socket says 172.21.15.57:49792) 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3a92c6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a41b4e90 0x7fa3a41bb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50444/0 (socket says 172.21.15.57:50444) 2024-04-25T02:06:17.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.542 7fa3a8ac5700 1 -- 172.21.15.57:0/4253730351 learned_addr learned my addr 172.21.15.57:0/4253730351 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa39bfff700 1 -- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a41b4e90 msgr2=0x7fa3a41bb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa39bfff700 1 --2- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a41b4e90 0x7fa3a41bb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa39bfff700 1 -- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40cc810 msgr2=0x7fa3a40ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa39bfff700 1 --2- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40cc810 0x7fa3a40ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa39bfff700 1 -- 172.21.15.57:0/4253730351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40cec70 con 0x7fa3a41b4410 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa39bfff700 1 --2- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a41b4410 0x7fa3a41b4860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fa3a40d89f0 tx=0x7fa39400eb60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa399ffb700 1 -- 172.21.15.57:0/4253730351 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3a40cec70 con 0x7fa3a41b4410 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa399ffb700 1 -- 172.21.15.57:0/4253730351 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa394010780 con 0x7fa3a41b4410 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a40ce9b0 con 0x7fa3a41b4410 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa399ffb700 1 -- 172.21.15.57:0/4253730351 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa39400f040 con 0x7fa3a41b4410 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a41bc100 con 0x7fa3a41b4410 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.543 7fa399ffb700 1 -- 172.21.15.57:0/4253730351 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa394011070 con 0x7fa3a41b4410 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.544 7fa399ffb700 1 -- 172.21.15.57:0/4253730351 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa394010040 con 0x7fa3a41b4410 2024-04-25T02:06:17.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.544 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a40f0860 con 0x7fa3a41b4410 2024-04-25T02:06:17.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.547 7fa399ffb700 1 -- 172.21.15.57:0/4253730351 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa394010380 con 0x7fa3a41b4410 2024-04-25T02:06:17.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.692 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a41aeaa0 con 0x7fa3a41b4410 2024-04-25T02:06:17.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.693 7fa399ffb700 1 -- 172.21.15.57:0/4253730351 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1702 (secure 0 0 0) 0x7fa394000c30 con 0x7fa3a41b4410 2024-04-25T02:06:17.700 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:17.700 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:05:47.333033","modified":"2024-04-25 02:05:49.360768","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 >> v1:172.21.15.57:6816/43033 conn(0x7fa3840145b0 legacy=0x7fa384016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a41b4410 msgr2=0x7fa3a41b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 --2- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a41b4410 0x7fa3a41b4860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fa3a40d89f0 tx=0x7fa39400eb60).stop 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 shutdown_connections 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 --2- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa3a41b4e90 0x7fa3a41bb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 --2- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa3a40cc810 0x7fa3a40ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 --2- 172.21.15.57:0/4253730351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3a41b4410 0x7fa3a41b4860 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 >> 172.21.15.57:0/4253730351 conn(0x7fa3a40de820 msgr2=0x7fa3a40d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 shutdown_connections 2024-04-25T02:06:17.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.694 7fa3abcca700 1 -- 172.21.15.57:0/4253730351 wait complete. 2024-04-25T02:06:17.702 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T02:06:17.712 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:17.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.836 7f5fb7072700 1 Processor -- start 2024-04-25T02:06:17.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.836 7f5fb7072700 1 -- start start 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5fb7072700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00f3540 0x7f5fb00f1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5fb7072700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5fb00f1fa0 0x7f5fb010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5fb7072700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00f23f0 0x7f5fb010eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5fb7072700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00f9560 con 0x7f5fb00f1fa0 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5fb7072700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00f3990 con 0x7f5fb00f23f0 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5fb7072700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00fa3c0 con 0x7f5fb00f3540 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00f3540 0x7f5fb00f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5fb00f1fa0 0x7f5fb010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00f23f0 0x7f5fb010eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5fb00f1fa0 0x7f5fb010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50944/0 (socket says 172.21.15.57:50944) 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00f3540 0x7f5fb00f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50454/0 (socket says 172.21.15.57:50454) 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00f23f0 0x7f5fb010eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49806/0 (socket says 172.21.15.57:49806) 2024-04-25T02:06:17.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 -- 172.21.15.57:0/1860081692 learned_addr learned my addr 172.21.15.57:0/1860081692 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 -- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00f3540 msgr2=0x7f5fb00f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00f3540 0x7f5fb00f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 -- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00f23f0 msgr2=0x7f5fb010eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00f23f0 0x7f5fb010eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 -- 172.21.15.57:0/1860081692 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb010f110 con 0x7f5fb00f1fa0 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faf7fe700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00f3540 0x7f5fb00f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faffff700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00f23f0 0x7f5fb010eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.837 7f5faeffd700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00f1fa0 0x7f5fb010e4b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f5fb0113410 tx=0x7f5fa4009a80).ready entity=mon.0 client_cookie=c9c0a111641de2ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fae7fc700 1 -- 172.21.15.57:0/1860081692 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fb010f110 con 0x7f5fb00f1fa0 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fae7fc700 1 -- 172.21.15.57:0/1860081692 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa400f510 con 0x7f5fb00f1fa0 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fae7fc700 1 -- 172.21.15.57:0/1860081692 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fa400f6f0 con 0x7f5fb00f1fa0 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 -- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00f1fa0 msgr2=0x7f5fb010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00f1fa0 0x7f5fb010e4b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f5fb0113410 tx=0x7f5fa4009a80).stop 2024-04-25T02:06:17.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 -- 172.21.15.57:0/1860081692 shutdown_connections 2024-04-25T02:06:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00f23f0 0x7f5fb010eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00f3540 0x7f5fb00f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 --2- 172.21.15.57:0/1860081692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00f1fa0 0x7f5fb010e4b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 -- 172.21.15.57:0/1860081692 >> 172.21.15.57:0/1860081692 conn(0x7f5fb0113a80 msgr2=0x7f5fb00f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 -- 172.21.15.57:0/1860081692 shutdown_connections 2024-04-25T02:06:17.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.838 7f5fb7072700 1 -- 172.21.15.57:0/1860081692 wait complete. 2024-04-25T02:06:17.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.862 7f5fb7072700 1 Processor -- start 2024-04-25T02:06:17.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.862 7f5fb7072700 1 -- start start 2024-04-25T02:06:17.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5fb7072700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00cf740 0x7f5fb00d6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5fb7072700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00d6650 0x7f5fb01b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5fb7072700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00d6aa0 0x7f5fb01b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5fb7072700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c4550 con 0x7f5fb00d6650 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5fb7072700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01a8a50 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5fb7072700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01b4c50 con 0x7f5fb00cf740 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00cf740 0x7f5fb00d6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00cf740 0x7f5fb00d6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50466/0 (socket says 172.21.15.57:50466) 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00d6650 0x7f5fb01b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faf7fe700 1 -- 172.21.15.57:0/2989930023 learned_addr learned my addr 172.21.15.57:0/2989930023 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faffff700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00d6aa0 0x7f5fb01b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faffff700 1 -- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00cf740 msgr2=0x7f5fb00d6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faffff700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00cf740 0x7f5fb00d6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faffff700 1 -- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00d6650 msgr2=0x7f5fb01b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faffff700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00d6650 0x7f5fb01b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faffff700 1 -- 172.21.15.57:0/2989930023 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb01b4e80 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faeffd700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00d6650 0x7f5fb01b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faf7fe700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00cf740 0x7f5fb00d6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.863 7f5faffff700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00d6aa0 0x7f5fb01b4620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5fb00c5de0 tx=0x7f5fa800ed50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.864 7f5facff9700 1 -- 172.21.15.57:0/2989930023 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fb01b4e80 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.864 7f5facff9700 1 -- 172.21.15.57:0/2989930023 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800c880 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.864 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb01bb6e0 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.864 7f5facff9700 1 -- 172.21.15.57:0/2989930023 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5fa800f040 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.864 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb01bbac0 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.864 7f5facff9700 1 -- 172.21.15.57:0/2989930023 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5fa8022060 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.864 7f5facff9700 1 -- 172.21.15.57:0/2989930023 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5fa8010040 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.865 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00f08e0 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.868 7f5facff9700 1 -- 172.21.15.57:0/2989930023 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5fa800c670 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.978 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fb01ae730 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.979 7f5facff9700 1 -- 172.21.15.57:0/2989930023 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f5fb0114600 con 0x7f5fb00d6aa0 2024-04-25T02:06:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:17.986 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:17.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 >> v1:172.21.15.57:6816/43033 conn(0x7f5f900145b0 legacy=0x7f5f90016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00d6aa0 msgr2=0x7f5fb01b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00d6aa0 0x7f5fb01b4620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5fb00c5de0 tx=0x7f5fa800ed50).stop 2024-04-25T02:06:17.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 shutdown_connections 2024-04-25T02:06:17.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fb00d6aa0 0x7f5fb01b4620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fb00cf740 0x7f5fb00d6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 --2- 172.21.15.57:0/2989930023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fb00d6650 0x7f5fb01b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:17.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 >> 172.21.15.57:0/2989930023 conn(0x7f5fb00c3920 msgr2=0x7f5fb00daea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 shutdown_connections 2024-04-25T02:06:17.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:17.980 7f5fb7072700 1 -- 172.21.15.57:0/2989930023 wait complete. 2024-04-25T02:06:17.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:05:45.808052', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:05:46.304771', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:17.998 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.125 7fa7246ab700 1 Processor -- start 2024-04-25T02:06:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.125 7fa7246ab700 1 -- start start 2024-04-25T02:06:18.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.125 7fa7246ab700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa71c0f5990 0x7fa71c10b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.125 7fa7246ab700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c10b6c0 0x7fa71c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.125 7fa7246ab700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c1a09f0 con 0x7fa71c10bb10 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.125 7fa7246ab700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c0fa510 con 0x7fa71c0f5990 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.125 7fa7246ab700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c1a0c10 con 0x7fa71c10b6c0 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa7214a6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa71c0f5990 0x7fa71c10b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa720ca5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c10b6c0 0x7fa71c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa721ca7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa71c10bb10 0x7fa71c1a01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47312/0 (socket says 172.21.15.57:47312) 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa721ca7700 1 -- 172.21.15.57:0/2775772312 learned_addr learned my addr 172.21.15.57:0/2775772312 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa7214a6700 1 -- 172.21.15.57:0/2775772312 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c10b6c0 msgr2=0x7fa71c19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa7214a6700 1 --2- 172.21.15.57:0/2775772312 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c10b6c0 0x7fa71c19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa7214a6700 1 -- 172.21.15.57:0/2775772312 >> v1:172.21.15.57:6789/0 conn(0x7fa71c10bb10 legacy=0x7fa71c1a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa70bfff700 1 -- 172.21.15.57:0/2775772312 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442325649 0 0) 0x7fa714001490 con 0x7fa71c10bb10 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa7214a6700 1 -- 172.21.15.57:0/2775772312 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c1a9350 con 0x7fa71c0f5990 2024-04-25T02:06:18.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa720ca5700 1 --2- 172.21.15.57:0/2775772312 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c10b6c0 0x7fa71c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa7214a6700 1 --2- 172.21.15.57:0/2775772312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0f5990 0x7fa71c10b090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa71c10f8a0 tx=0x7fa70c00ba20).ready entity=mon.0 client_cookie=c131bb05cb1736bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa70bfff700 1 -- 172.21.15.57:0/2775772312 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa71c1a9350 con 0x7fa71c0f5990 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa70bfff700 1 -- 172.21.15.57:0/2775772312 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c00d5c0 con 0x7fa71c0f5990 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa70bfff700 1 -- 172.21.15.57:0/2775772312 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa70c00d990 con 0x7fa71c0f5990 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa7246ab700 1 -- 172.21.15.57:0/2775772312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0f5990 msgr2=0x7fa71c10b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.126 7fa7246ab700 1 --2- 172.21.15.57:0/2775772312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0f5990 0x7fa71c10b090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa71c10f8a0 tx=0x7fa70c00ba20).stop 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.127 7fa7246ab700 1 -- 172.21.15.57:0/2775772312 shutdown_connections 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.127 7fa7246ab700 1 --2- 172.21.15.57:0/2775772312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0f5990 0x7fa71c10b090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.127 7fa7246ab700 1 --2- 172.21.15.57:0/2775772312 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c10b6c0 0x7fa71c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.127 7fa7246ab700 1 -- 172.21.15.57:0/2775772312 >> 172.21.15.57:0/2775772312 conn(0x7fa71c1139f0 msgr2=0x7fa71c0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.127 7fa7246ab700 1 -- 172.21.15.57:0/2775772312 shutdown_connections 2024-04-25T02:06:18.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.127 7fa7246ab700 1 -- 172.21.15.57:0/2775772312 wait complete. 2024-04-25T02:06:18.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.151 7fa7246ab700 1 Processor -- start 2024-04-25T02:06:18.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.151 7fa7246ab700 1 -- start start 2024-04-25T02:06:18.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7246ab700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa71c0cc0c0 0x7fa71c0d5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7246ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0d5980 0x7fa71c1b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7246ab700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c0d5dd0 0x7fa71c1b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7246ab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c088da0 con 0x7fa71c0d5980 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7246ab700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c1b1a30 con 0x7fa71c0cc0c0 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7246ab700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c1b1c30 con 0x7fa71c0d5dd0 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7214a6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa71c0cc0c0 0x7fa71c0d5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa720ca5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0d5980 0x7fa71c1b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7214a6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa71c0cc0c0 0x7fa71c0d5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49822/0 (socket says 172.21.15.57:49822) 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7214a6700 1 -- 172.21.15.57:0/3030459347 learned_addr learned my addr 172.21.15.57:0/3030459347 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa721ca7700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c0d5dd0 0x7fa71c1b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa720ca5700 1 -- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c0d5dd0 msgr2=0x7fa71c1b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa720ca5700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c0d5dd0 0x7fa71c1b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa720ca5700 1 -- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa71c0cc0c0 msgr2=0x7fa71c0d5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa720ca5700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa71c0cc0c0 0x7fa71c0d5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa720ca5700 1 -- 172.21.15.57:0/3030459347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c1b1e60 con 0x7fa71c0d5980 2024-04-25T02:06:18.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa7214a6700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa71c0cc0c0 0x7fa71c0d5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa720ca5700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0d5980 0x7fa71c1b0dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fa71800c000 tx=0x7fa71800eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.152 7fa70a7fc700 1 -- 172.21.15.57:0/3030459347 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa71800f040 con 0x7fa71c0d5980 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.153 7fa70a7fc700 1 -- 172.21.15.57:0/3030459347 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71800c790 con 0x7fa71c0d5980 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.153 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c1b84c0 con 0x7fa71c0d5980 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.153 7fa70a7fc700 1 -- 172.21.15.57:0/3030459347 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa71800cb60 con 0x7fa71c0d5980 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.153 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c1b88a0 con 0x7fa71c0d5980 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.153 7fa70a7fc700 1 -- 172.21.15.57:0/3030459347 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa718011070 con 0x7fa71c0d5980 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.153 7fa70a7fc700 1 -- 172.21.15.57:0/3030459347 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa718010040 con 0x7fa71c0d5980 2024-04-25T02:06:18.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.154 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c0f0860 con 0x7fa71c0d5980 2024-04-25T02:06:18.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.157 7fa70a7fc700 1 -- 172.21.15.57:0/3030459347 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa71c1b1e60 con 0x7fa71c0d5980 2024-04-25T02:06:18.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.267 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa71c1ab550 con 0x7fa71c0d5980 2024-04-25T02:06:18.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.268 7fa70a7fc700 1 -- 172.21.15.57:0/3030459347 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa718000c30 con 0x7fa71c0d5980 2024-04-25T02:06:18.275 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 >> v1:172.21.15.57:6816/43033 conn(0x7fa6fc0145b0 legacy=0x7fa6fc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0d5980 msgr2=0x7fa71c1b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0d5980 0x7fa71c1b0dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fa71800c000 tx=0x7fa71800eca0).stop 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 shutdown_connections 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa71c0d5dd0 0x7fa71c1b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa71c0cc0c0 0x7fa71c0d5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 --2- 172.21.15.57:0/3030459347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa71c0d5980 0x7fa71c1b0dd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 >> 172.21.15.57:0/3030459347 conn(0x7fa71c0c5880 msgr2=0x7fa71c1a5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:18.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 shutdown_connections 2024-04-25T02:06:18.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.269 7fa7246ab700 1 -- 172.21.15.57:0/3030459347 wait complete. 2024-04-25T02:06:18.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:18.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.414 7fbe503d8700 1 Processor -- start 2024-04-25T02:06:18.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.414 7fbe503d8700 1 -- start start 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.414 7fbe503d8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480f58a0 0x7fbe480f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.414 7fbe503d8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe480f2290 0x7fbe4810ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.414 7fbe503d8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe480f91b0 con 0x7fbe480f1e40 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.414 7fbe503d8700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4810f060 con 0x7fbe480f2290 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.414 7fbe503d8700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481ac600 con 0x7fbe480f58a0 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.414 7fbe4d1d3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480f58a0 0x7fbe480f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d9d4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe480f2290 0x7fbe4810ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d1d3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480f58a0 0x7fbe480f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50490/0 (socket says 172.21.15.57:50490) 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d1d3700 1 -- 172.21.15.57:0/4109732137 learned_addr learned my addr 172.21.15.57:0/4109732137 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4c9d2700 1 --1- 172.21.15.57:0/4109732137 >> v1:172.21.15.57:6789/0 conn(0x7fbe480f1e40 0x7fbe4810e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47322/0 (socket says 172.21.15.57:47322) 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d9d4700 1 -- 172.21.15.57:0/4109732137 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480f58a0 msgr2=0x7fbe480f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d9d4700 1 --2- 172.21.15.57:0/4109732137 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480f58a0 0x7fbe480f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d9d4700 1 -- 172.21.15.57:0/4109732137 >> v1:172.21.15.57:6789/0 conn(0x7fbe480f1e40 legacy=0x7fbe4810e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d9d4700 1 -- 172.21.15.57:0/4109732137 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe481ac7b0 con 0x7fbe480f2290 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe37fff700 1 -- 172.21.15.57:0/4109732137 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337738079 0 0) 0x7fbe38001110 con 0x7fbe480f1e40 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d1d3700 1 --2- 172.21.15.57:0/4109732137 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480f58a0 0x7fbe480f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe4d9d4700 1 --2- 172.21.15.57:0/4109732137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480f2290 0x7fbe4810ea30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbe400032f0 tx=0x7fbe40009d10).ready entity=mon.0 client_cookie=d3eb35669e544cfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe37fff700 1 -- 172.21.15.57:0/4109732137 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbe481ac7b0 con 0x7fbe480f2290 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe37fff700 1 -- 172.21.15.57:0/4109732137 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4000b800 con 0x7fbe480f2290 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe37fff700 1 -- 172.21.15.57:0/4109732137 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbe4000b9e0 con 0x7fbe480f2290 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe503d8700 1 -- 172.21.15.57:0/4109732137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480f2290 msgr2=0x7fbe4810ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.415 7fbe503d8700 1 --2- 172.21.15.57:0/4109732137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480f2290 0x7fbe4810ea30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbe400032f0 tx=0x7fbe40009d10).stop 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.416 7fbe503d8700 1 -- 172.21.15.57:0/4109732137 shutdown_connections 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.416 7fbe503d8700 1 --2- 172.21.15.57:0/4109732137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe480f2290 0x7fbe4810ea30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.416 7fbe503d8700 1 --2- 172.21.15.57:0/4109732137 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480f58a0 0x7fbe480f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.416 7fbe503d8700 1 -- 172.21.15.57:0/4109732137 >> 172.21.15.57:0/4109732137 conn(0x7fbe481139f0 msgr2=0x7fbe480f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.416 7fbe503d8700 1 -- 172.21.15.57:0/4109732137 shutdown_connections 2024-04-25T02:06:18.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.416 7fbe503d8700 1 -- 172.21.15.57:0/4109732137 wait complete. 2024-04-25T02:06:18.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe503d8700 1 Processor -- start 2024-04-25T02:06:18.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe503d8700 1 -- start start 2024-04-25T02:06:18.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe503d8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480df740 0x7fbe481afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe503d8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe481b0250 0x7fbe481b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe503d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe481b4360 0x7fbe481b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe503d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480dff70 con 0x7fbe481b4360 2024-04-25T02:06:18.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe503d8700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481b4de0 con 0x7fbe481b0250 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe503d8700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481b06a0 con 0x7fbe480df740 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe4c9d2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe481b0250 0x7fbe481b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe4d9d4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe481b4360 0x7fbe481b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe4d1d3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480df740 0x7fbe481afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe4d9d4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe481b4360 0x7fbe481b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51004/0 (socket says 172.21.15.57:51004) 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.440 7fbe4d9d4700 1 -- 172.21.15.57:0/957570638 learned_addr learned my addr 172.21.15.57:0/957570638 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe4d1d3700 1 -- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe481b0250 msgr2=0x7fbe481b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe4d1d3700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe481b0250 0x7fbe481b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe4d1d3700 1 -- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe481b4360 msgr2=0x7fbe481b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe4d1d3700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe481b4360 0x7fbe481b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe4d1d3700 1 -- 172.21.15.57:0/957570638 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe481bb1f0 con 0x7fbe480df740 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe4d9d4700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe481b4360 0x7fbe481b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe4c9d2700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe481b0250 0x7fbe481b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe4d1d3700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480df740 0x7fbe481afc20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbe480d90c0 tx=0x7fbe4400ea80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe367fc700 1 -- 172.21.15.57:0/957570638 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbe481bb1f0 con 0x7fbe480df740 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe367fc700 1 -- 172.21.15.57:0/957570638 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44012600 con 0x7fbe480df740 2024-04-25T02:06:18.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe503d8700 1 -- 172.21.15.57:0/957570638 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe481bb3f0 con 0x7fbe480df740 2024-04-25T02:06:18.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe367fc700 1 -- 172.21.15.57:0/957570638 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbe4400f040 con 0x7fbe480df740 2024-04-25T02:06:18.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.441 7fbe503d8700 1 -- 172.21.15.57:0/957570638 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe481bb7d0 con 0x7fbe480df740 2024-04-25T02:06:18.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.442 7fbe367fc700 1 -- 172.21.15.57:0/957570638 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fbe44011070 con 0x7fbe480df740 2024-04-25T02:06:18.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.442 7fbe367fc700 1 -- 172.21.15.57:0/957570638 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fbe44010040 con 0x7fbe480df740 2024-04-25T02:06:18.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.442 7fbe503d8700 1 -- 172.21.15.57:0/957570638 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe480f0860 con 0x7fbe480df740 2024-04-25T02:06:18.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.445 7fbe367fc700 1 -- 172.21.15.57:0/957570638 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fbe440123f0 con 0x7fbe480df740 2024-04-25T02:06:18.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.557 7fbe503d8700 1 -- 172.21.15.57:0/957570638 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe480d2240 con 0x7fbe480df740 2024-04-25T02:06:18.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.557 7fbe367fc700 1 -- 172.21.15.57:0/957570638 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe44000c30 con 0x7fbe480df740 2024-04-25T02:06:18.564 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:18.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 -- 172.21.15.57:0/957570638 >> v1:172.21.15.57:6816/43033 conn(0x7fbe280145b0 legacy=0x7fbe28016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 -- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480df740 msgr2=0x7fbe481afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480df740 0x7fbe481afc20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbe480d90c0 tx=0x7fbe4400ea80).stop 2024-04-25T02:06:18.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 -- 172.21.15.57:0/957570638 shutdown_connections 2024-04-25T02:06:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe481b4360 0x7fbe481b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe480df740 0x7fbe481afc20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 --2- 172.21.15.57:0/957570638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe481b0250 0x7fbe481b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 -- 172.21.15.57:0/957570638 >> 172.21.15.57:0/957570638 conn(0x7fbe480dbf20 msgr2=0x7fbe480d8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 -- 172.21.15.57:0/957570638 shutdown_connections 2024-04-25T02:06:18.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.558 7fbe503d8700 1 -- 172.21.15.57:0/957570638 wait complete. 2024-04-25T02:06:18.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:18.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.703 7f3d3430b700 1 Processor -- start 2024-04-25T02:06:18.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.703 7f3d3430b700 1 -- start start 2024-04-25T02:06:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.703 7f3d3430b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d2c0f5a10 0x7f3d2c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.703 7f3d3430b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c10b740 0x7f3d2c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.703 7f3d3430b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c1a0a70 con 0x7f3d2c10bb90 2024-04-25T02:06:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.703 7f3d3430b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0fa590 con 0x7f3d2c0f5a10 2024-04-25T02:06:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.703 7f3d3430b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c1a0c90 con 0x7f3d2c10b740 2024-04-25T02:06:18.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d30905700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c10b740 0x7f3d2c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d31106700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d2c0f5a10 0x7f3d2c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d30905700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c10b740 0x7f3d2c19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49838/0 (socket says 172.21.15.57:49838) 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d30905700 1 -- 172.21.15.57:0/3375210126 learned_addr learned my addr 172.21.15.57:0/3375210126 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d31907700 1 --1- 172.21.15.57:0/3375210126 >> v1:172.21.15.57:6789/0 conn(0x7f3d2c10bb90 0x7f3d2c1a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47338/0 (socket says 172.21.15.57:47338) 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d1bfff700 1 -- 172.21.15.57:0/3375210126 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389095613 0 0) 0x7f3d24001490 con 0x7f3d2c10bb90 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d1bfff700 1 -- 172.21.15.57:0/3375210126 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d14003270 con 0x7f3d2c10bb90 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d30905700 1 -- 172.21.15.57:0/3375210126 >> v2:172.21.15.57:3300/0 conn(0x7f3d2c0f5a10 msgr2=0x7f3d2c10b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d30905700 1 --2- 172.21.15.57:0/3375210126 >> v2:172.21.15.57:3300/0 conn(0x7f3d2c0f5a10 0x7f3d2c10b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d30905700 1 -- 172.21.15.57:0/3375210126 >> v1:172.21.15.57:6789/0 conn(0x7f3d2c10bb90 legacy=0x7f3d2c1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d30905700 1 -- 172.21.15.57:0/3375210126 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c1a93d0 con 0x7f3d2c10b740 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d31106700 1 --2- 172.21.15.57:0/3375210126 >> v2:172.21.15.57:3300/0 conn(0x7f3d2c0f5a10 0x7f3d2c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d30905700 1 --2- 172.21.15.57:0/3375210126 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c10b740 0x7f3d2c19fc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3d2c103a10 tx=0x7f3d1c00bc30).ready entity=mon.1 client_cookie=2d8cf44c4bc275a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d1bfff700 1 -- 172.21.15.57:0/3375210126 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3d2c1a93d0 con 0x7f3d2c10b740 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d1bfff700 1 -- 172.21.15.57:0/3375210126 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00dc40 con 0x7f3d2c10b740 2024-04-25T02:06:18.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d1bfff700 1 -- 172.21.15.57:0/3375210126 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3d1c010660 con 0x7f3d2c10b740 2024-04-25T02:06:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d3430b700 1 -- 172.21.15.57:0/3375210126 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c10b740 msgr2=0x7f3d2c19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.704 7f3d3430b700 1 --2- 172.21.15.57:0/3375210126 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c10b740 0x7f3d2c19fc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3d2c103a10 tx=0x7f3d1c00bc30).stop 2024-04-25T02:06:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.705 7f3d3430b700 1 -- 172.21.15.57:0/3375210126 shutdown_connections 2024-04-25T02:06:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.705 7f3d3430b700 1 --2- 172.21.15.57:0/3375210126 >> v2:172.21.15.57:3300/0 conn(0x7f3d2c0f5a10 0x7f3d2c10b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.705 7f3d3430b700 1 --2- 172.21.15.57:0/3375210126 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c10b740 0x7f3d2c19fc40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.705 7f3d3430b700 1 -- 172.21.15.57:0/3375210126 >> 172.21.15.57:0/3375210126 conn(0x7f3d2c113a70 msgr2=0x7f3d2c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.705 7f3d3430b700 1 -- 172.21.15.57:0/3375210126 shutdown_connections 2024-04-25T02:06:18.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.705 7f3d3430b700 1 -- 172.21.15.57:0/3375210126 wait complete. 2024-04-25T02:06:18.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d3430b700 1 Processor -- start 2024-04-25T02:06:18.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d3430b700 1 -- start start 2024-04-25T02:06:18.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d3430b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3d2c0dcf30 0x7f3d2c0dd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d3430b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c1ad0f0 0x7f3d2c1ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d3430b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d2c1adb70 0x7f3d2c1b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d3430b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c1b16f0 con 0x7f3d2c1adb70 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d3430b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c1adfc0 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d3430b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0c3de0 con 0x7f3d2c0dcf30 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d31106700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3d2c0dcf30 0x7f3d2c0dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d30905700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c1ad0f0 0x7f3d2c1ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d31907700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d2c1adb70 0x7f3d2c1b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d31106700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3d2c0dcf30 0x7f3d2c0dd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50504/0 (socket says 172.21.15.57:50504) 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.729 7f3d31106700 1 -- 172.21.15.57:0/3146821032 learned_addr learned my addr 172.21.15.57:0/3146821032 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d30905700 1 -- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3d2c0dcf30 msgr2=0x7f3d2c0dd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d30905700 1 --2- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3d2c0dcf30 0x7f3d2c0dd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d30905700 1 -- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d2c1adb70 msgr2=0x7f3d2c1b7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d30905700 1 --2- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d2c1adb70 0x7f3d2c1b7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d30905700 1 -- 172.21.15.57:0/3146821032 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0d9a60 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d30905700 1 --2- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c1ad0f0 0x7f3d2c1ad540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3d2c0ce810 tx=0x7f3d1c006cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d1a7fc700 1 -- 172.21.15.57:0/3146821032 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3d2c0d9a60 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d1a7fc700 1 -- 172.21.15.57:0/3146821032 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c010b00 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d1a7fc700 1 -- 172.21.15.57:0/3146821032 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3d1c024450 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c0d9380 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.730 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c1b81c0 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.731 7f3d1a7fc700 1 -- 172.21.15.57:0/3146821032 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3d1c024650 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.731 7f3d1a7fc700 1 -- 172.21.15.57:0/3146821032 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3d1c01d130 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.731 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c0f08e0 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.734 7f3d1a7fc700 1 -- 172.21.15.57:0/3146821032 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f3d1c0108f0 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.847 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d2c0da490 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.847 7f3d1a7fc700 1 -- 172.21.15.57:0/3146821032 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d1c00d840 con 0x7f3d2c1ad0f0 2024-04-25T02:06:18.854 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 >> v1:172.21.15.57:6816/43033 conn(0x7f3d0c0145b0 legacy=0x7f3d0c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c1ad0f0 msgr2=0x7f3d2c1ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 --2- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c1ad0f0 0x7f3d2c1ad540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3d2c0ce810 tx=0x7f3d1c006cd0).stop 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 shutdown_connections 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 --2- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d2c1adb70 0x7f3d2c1b7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 --2- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3d2c0dcf30 0x7f3d2c0dd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 --2- 172.21.15.57:0/3146821032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d2c1ad0f0 0x7f3d2c1ad540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 >> 172.21.15.57:0/3146821032 conn(0x7f3d2c0e0910 msgr2=0x7f3d2c0cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 shutdown_connections 2024-04-25T02:06:18.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.849 7f3d3430b700 1 -- 172.21.15.57:0/3146821032 wait complete. 2024-04-25T02:06:18.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:18.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.991 7f88c97f4700 1 Processor -- start 2024-04-25T02:06:18.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.991 7f88c97f4700 1 -- start start 2024-04-25T02:06:19.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88c97f4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40f58a0 0x7f88c40f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88c97f4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88c40f1e40 0x7f88c410e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88c97f4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c40f2290 0x7f88c410e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88c97f4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c40f91b0 con 0x7f88c40f1e40 2024-04-25T02:06:19.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88c97f4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c410ee90 con 0x7f88c40f2290 2024-04-25T02:06:19.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88c97f4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88c41aa5e0 con 0x7f88c40f58a0 2024-04-25T02:06:19.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88b9dc4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88c40f1e40 0x7f88c410e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88c25c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40f58a0 0x7f88c40f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88b9dc4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88c40f1e40 0x7f88c410e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51040/0 (socket says 172.21.15.57:51040) 2024-04-25T02:06:19.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88b9dc4700 1 -- 172.21.15.57:0/2511372268 learned_addr learned my addr 172.21.15.57:0/2511372268 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:19.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88c2dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c40f2290 0x7f88c410e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88b9dc4700 1 -- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40f58a0 msgr2=0x7f88c40f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:19.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.992 7f88b9dc4700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40f58a0 0x7f88c40f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88b9dc4700 1 -- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c40f2290 msgr2=0x7f88c410e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:19.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88b9dc4700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c40f2290 0x7f88c410e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88b9dc4700 1 -- 172.21.15.57:0/2511372268 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c41aa790 con 0x7f88c40f1e40 2024-04-25T02:06:19.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88c25c5700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40f58a0 0x7f88c40f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88c2dc6700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c40f2290 0x7f88c410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88b9dc4700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40f1e40 0x7f88c410e230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f88c4103770 tx=0x7f88ac009a80).ready entity=mon.0 client_cookie=eef6f70d740b02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88c1dc4700 1 -- 172.21.15.57:0/2511372268 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88c41aa790 con 0x7f88c40f1e40 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88c1dc4700 1 -- 172.21.15.57:0/2511372268 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac00f510 con 0x7f88c40f1e40 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88c1dc4700 1 -- 172.21.15.57:0/2511372268 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88ac00f6f0 con 0x7f88c40f1e40 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88c97f4700 1 -- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40f1e40 msgr2=0x7f88c410e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.993 7f88c97f4700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40f1e40 0x7f88c410e230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f88c4103770 tx=0x7f88ac009a80).stop 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.994 7f88c97f4700 1 -- 172.21.15.57:0/2511372268 shutdown_connections 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.994 7f88c97f4700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c40f2290 0x7f88c410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.994 7f88c97f4700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40f58a0 0x7f88c40f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.994 7f88c97f4700 1 --2- 172.21.15.57:0/2511372268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40f1e40 0x7f88c410e230 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.994 7f88c97f4700 1 -- 172.21.15.57:0/2511372268 >> 172.21.15.57:0/2511372268 conn(0x7f88c41139f0 msgr2=0x7f88c40f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.994 7f88c97f4700 1 -- 172.21.15.57:0/2511372268 shutdown_connections 2024-04-25T02:06:19.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:18.994 7f88c97f4700 1 -- 172.21.15.57:0/2511372268 wait complete. 2024-04-25T02:06:19.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.017 7f88c97f4700 1 Processor -- start 2024-04-25T02:06:19.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.017 7f88c97f4700 1 -- start start 2024-04-25T02:06:19.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c97f4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40cc3d0 0x7f88c40cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c97f4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40cce50 0x7f88c41b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c97f4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c41b4c90 0x7f88c41b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c97f4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40be7a0 con 0x7f88c40cce50 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c97f4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40ddac0 con 0x7f88c41b4c90 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c97f4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40dcf00 con 0x7f88c40cc3d0 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c25c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40cc3d0 0x7f88c40cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88b9dc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40cce50 0x7f88c41b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c2dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c41b4c90 0x7f88c41b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c25c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40cc3d0 0x7f88c40cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50526/0 (socket says 172.21.15.57:50526) 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88b9dc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40cce50 0x7f88c41b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51050/0 (socket says 172.21.15.57:51050) 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c2dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c41b4c90 0x7f88c41b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49870/0 (socket says 172.21.15.57:49870) 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c25c5700 1 -- 172.21.15.57:0/3487784413 learned_addr learned my addr 172.21.15.57:0/3487784413 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88b9dc4700 1 -- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40cc3d0 msgr2=0x7f88c40cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88b9dc4700 1 --2- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40cc3d0 0x7f88c40cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88b9dc4700 1 -- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c41b4c90 msgr2=0x7f88c41b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88b9dc4700 1 --2- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c41b4c90 0x7f88c41b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88b9dc4700 1 -- 172.21.15.57:0/3487784413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40f0180 con 0x7f88c40cce50 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88c25c5700 1 --2- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40cc3d0 0x7f88c40cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.018 7f88b9dc4700 1 --2- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40cce50 0x7f88c41b4660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f88c40d0940 tx=0x7f88ac0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.019 7f88bbfff700 1 -- 172.21.15.57:0/3487784413 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88c40f0180 con 0x7f88c40cce50 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.019 7f88bbfff700 1 -- 172.21.15.57:0/3487784413 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac011610 con 0x7f88c40cce50 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.019 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c41bbe60 con 0x7f88c40cce50 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.019 7f88bbfff700 1 -- 172.21.15.57:0/3487784413 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88ac022070 con 0x7f88c40cce50 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.019 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c41bc240 con 0x7f88c40cce50 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.019 7f88bbfff700 1 -- 172.21.15.57:0/3487784413 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f88ac0119e0 con 0x7f88c40cce50 2024-04-25T02:06:19.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.019 7f88bbfff700 1 -- 172.21.15.57:0/3487784413 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f88ac020130 con 0x7f88c40cce50 2024-04-25T02:06:19.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.020 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c40f0860 con 0x7f88c40cce50 2024-04-25T02:06:19.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.023 7f88bbfff700 1 -- 172.21.15.57:0/3487784413 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f88ac00f300 con 0x7f88c40cce50 2024-04-25T02:06:19.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.165 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c40a61a0 con 0x7f88c40cce50 2024-04-25T02:06:19.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.166 7f88bbfff700 1 -- 172.21.15.57:0/3487784413 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1702 (secure 0 0 0) 0x7f88ac011400 con 0x7f88c40cce50 2024-04-25T02:06:19.173 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:19.173 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:05:47.333033","modified":"2024-04-25 02:05:49.360768","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:06:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 >> v1:172.21.15.57:6816/43033 conn(0x7f88a80145b0 legacy=0x7f88a8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40cce50 msgr2=0x7f88c41b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 --2- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40cce50 0x7f88c41b4660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f88c40d0940 tx=0x7f88ac0068c0).stop 2024-04-25T02:06:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 shutdown_connections 2024-04-25T02:06:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 --2- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c41b4c90 0x7f88c41b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 --2- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c40cc3d0 0x7f88c40cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 --2- 172.21.15.57:0/3487784413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c40cce50 0x7f88c41b4660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 >> 172.21.15.57:0/3487784413 conn(0x7f88c40de8b0 msgr2=0x7f88c40d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 shutdown_connections 2024-04-25T02:06:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.167 7f88c97f4700 1 -- 172.21.15.57:0/3487784413 wait complete. 2024-04-25T02:06:19.175 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T02:06:19.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:19.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.309 7ff48efb6700 1 Processor -- start 2024-04-25T02:06:19.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.309 7ff48efb6700 1 -- start start 2024-04-25T02:06:19.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff48efb6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880f5a10 0x7ff48810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff48efb6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff48810bb90 0x7ff4881a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff48efb6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4881a0a70 con 0x7ff48810b740 2024-04-25T02:06:19.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff48efb6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880fa590 con 0x7ff48810bb90 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff48efb6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881a0c90 con 0x7ff4880f5a10 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff4877fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880f5a10 0x7ff48810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff487fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff48810bb90 0x7ff4881a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff487fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff48810bb90 0x7ff4881a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51058/0 (socket says 172.21.15.57:51058) 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff4877fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880f5a10 0x7ff48810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49878/0 (socket says 172.21.15.57:49878) 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff487fff700 1 -- 172.21.15.57:0/1225775620 learned_addr learned my addr 172.21.15.57:0/1225775620 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff47effd700 1 --1- 172.21.15.57:0/1225775620 >> v1:172.21.15.57:6789/0 conn(0x7ff48810b740 0x7ff48819fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47348/0 (socket says 172.21.15.57:47348) 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff487fff700 1 -- 172.21.15.57:0/1225775620 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880f5a10 msgr2=0x7ff48810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff487fff700 1 --2- 172.21.15.57:0/1225775620 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880f5a10 0x7ff48810b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff487fff700 1 -- 172.21.15.57:0/1225775620 >> v1:172.21.15.57:6789/0 conn(0x7ff48810b740 legacy=0x7ff48819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff486ffd700 1 -- 172.21.15.57:0/1225775620 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415388404 0 0) 0x7ff470001110 con 0x7ff48810b740 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff487fff700 1 -- 172.21.15.57:0/1225775620 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4881a93d0 con 0x7ff48810bb90 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff4877fe700 1 --2- 172.21.15.57:0/1225775620 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880f5a10 0x7ff48810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.310 7ff487fff700 1 --2- 172.21.15.57:0/1225775620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48810bb90 0x7ff4881a0440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff4800032f0 tx=0x7ff480009de0).ready entity=mon.0 client_cookie=20728fcd00b41cd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:19.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff486ffd700 1 -- 172.21.15.57:0/1225775620 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4881a93d0 con 0x7ff48810bb90 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff486ffd700 1 -- 172.21.15.57:0/1225775620 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48000b8d0 con 0x7ff48810bb90 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff486ffd700 1 -- 172.21.15.57:0/1225775620 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff48000bab0 con 0x7ff48810bb90 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff48efb6700 1 -- 172.21.15.57:0/1225775620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48810bb90 msgr2=0x7ff4881a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff48efb6700 1 --2- 172.21.15.57:0/1225775620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48810bb90 0x7ff4881a0440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff4800032f0 tx=0x7ff480009de0).stop 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff48efb6700 1 -- 172.21.15.57:0/1225775620 shutdown_connections 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff48efb6700 1 --2- 172.21.15.57:0/1225775620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff48810bb90 0x7ff4881a0440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff48efb6700 1 --2- 172.21.15.57:0/1225775620 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880f5a10 0x7ff48810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff48efb6700 1 -- 172.21.15.57:0/1225775620 >> 172.21.15.57:0/1225775620 conn(0x7ff488113a70 msgr2=0x7ff4880f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff48efb6700 1 -- 172.21.15.57:0/1225775620 shutdown_connections 2024-04-25T02:06:19.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.311 7ff48efb6700 1 -- 172.21.15.57:0/1225775620 wait complete. 2024-04-25T02:06:19.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.335 7ff48efb6700 1 Processor -- start 2024-04-25T02:06:19.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.335 7ff48efb6700 1 -- start start 2024-04-25T02:06:19.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff48efb6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880d4110 0x7ff4880d4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff48efb6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4881affa0 0x7ff4881b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff48efb6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4881b0a20 0x7ff4881b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff48efb6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881ac9e0 con 0x7ff4881affa0 2024-04-25T02:06:19.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff48efb6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881063d0 con 0x7ff4880d4110 2024-04-25T02:06:19.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff48efb6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880d4b90 con 0x7ff4881b0a20 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff4877fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880d4110 0x7ff4880d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff4877fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880d4110 0x7ff4880d4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49890/0 (socket says 172.21.15.57:49890) 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff4877fe700 1 -- 172.21.15.57:0/2194944439 learned_addr learned my addr 172.21.15.57:0/2194944439 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff47effd700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4881affa0 0x7ff4881b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff487fff700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4881b0a20 0x7ff4881b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff47effd700 1 -- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4881b0a20 msgr2=0x7ff4881b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff47effd700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4881b0a20 0x7ff4881b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff47effd700 1 -- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880d4110 msgr2=0x7ff4880d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff47effd700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880d4110 0x7ff4880d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff47effd700 1 -- 172.21.15.57:0/2194944439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880dd210 con 0x7ff4881affa0 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.336 7ff4877fe700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880d4110 0x7ff4880d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.337 7ff47effd700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4881affa0 0x7ff4881b03f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff4881a3b80 tx=0x7ff47000c830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.337 7ff4857fa700 1 -- 172.21.15.57:0/2194944439 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff4880dd210 con 0x7ff4881affa0 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.337 7ff4857fa700 1 -- 172.21.15.57:0/2194944439 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4700070d0 con 0x7ff4881affa0 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.337 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880dc7e0 con 0x7ff4881affa0 2024-04-25T02:06:19.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.337 7ff4857fa700 1 -- 172.21.15.57:0/2194944439 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff470005560 con 0x7ff4881affa0 2024-04-25T02:06:19.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.337 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881b7ab0 con 0x7ff4881affa0 2024-04-25T02:06:19.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.337 7ff4857fa700 1 -- 172.21.15.57:0/2194944439 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff470005970 con 0x7ff4881affa0 2024-04-25T02:06:19.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.337 7ff4857fa700 1 -- 172.21.15.57:0/2194944439 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7ff470014770 con 0x7ff4881affa0 2024-04-25T02:06:19.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.338 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880f08e0 con 0x7ff4881affa0 2024-04-25T02:06:19.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.341 7ff4857fa700 1 -- 172.21.15.57:0/2194944439 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ff470005760 con 0x7ff4881affa0 2024-04-25T02:06:19.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.452 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4880d62e0 con 0x7ff4881affa0 2024-04-25T02:06:19.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.452 7ff4857fa700 1 -- 172.21.15.57:0/2194944439 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7ff470000c30 con 0x7ff4881affa0 2024-04-25T02:06:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:19.459 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 >> v1:172.21.15.57:6816/43033 conn(0x7ff46c0145b0 legacy=0x7ff46c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4881affa0 msgr2=0x7ff4881b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4881affa0 0x7ff4881b03f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff4881a3b80 tx=0x7ff47000c830).stop 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 shutdown_connections 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff4881b0a20 0x7ff4881b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff4880d4110 0x7ff4880d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 --2- 172.21.15.57:0/2194944439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4881affa0 0x7ff4881b03f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 >> 172.21.15.57:0/2194944439 conn(0x7ff4880c3790 msgr2=0x7ff4880c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 shutdown_connections 2024-04-25T02:06:19.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.454 7ff48efb6700 1 -- 172.21.15.57:0/2194944439 wait complete. 2024-04-25T02:06:19.471 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:06:19.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:19.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.595 7f8e83d7e700 1 Processor -- start 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e83d7e700 1 -- start start 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e83d7e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0f5920 0x7f8e7c0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e83d7e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c0f2310 0x7f8e7c10eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e83d7e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7c0f9230 con 0x7f8e7c0f1ec0 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e83d7e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c10f0e0 con 0x7f8e7c0f5920 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e83d7e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c1ac680 con 0x7f8e7c0f2310 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e80b79700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0f5920 0x7f8e7c0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e7bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8e7c0f1ec0 0x7f8e7c10e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47364/0 (socket says 172.21.15.57:47364) 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e7bfff700 1 -- 172.21.15.57:0/2746284586 learned_addr learned my addr 172.21.15.57:0/2746284586 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e8137a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c0f2310 0x7f8e7c10eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e7b7fe700 1 -- 172.21.15.57:0/2746284586 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845848119 0 0) 0x7f8e64001110 con 0x7f8e7c0f1ec0 2024-04-25T02:06:19.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e80b79700 1 -- 172.21.15.57:0/2746284586 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c0f2310 msgr2=0x7f8e7c10eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e80b79700 1 --2- 172.21.15.57:0/2746284586 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c0f2310 0x7f8e7c10eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e80b79700 1 -- 172.21.15.57:0/2746284586 >> v1:172.21.15.57:6789/0 conn(0x7f8e7c0f1ec0 legacy=0x7f8e7c10e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e80b79700 1 -- 172.21.15.57:0/2746284586 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c1ac830 con 0x7f8e7c0f5920 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.596 7f8e8137a700 1 --2- 172.21.15.57:0/2746284586 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c0f2310 0x7f8e7c10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e80b79700 1 --2- 172.21.15.57:0/2746284586 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0f5920 0x7f8e7c0f1890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8e7c1037f0 tx=0x7f8e6c00ba50).ready entity=mon.1 client_cookie=abfe414052e59bc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e7b7fe700 1 -- 172.21.15.57:0/2746284586 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e7c1ac830 con 0x7f8e7c0f5920 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e7b7fe700 1 -- 172.21.15.57:0/2746284586 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00d570 con 0x7f8e7c0f5920 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e7b7fe700 1 -- 172.21.15.57:0/2746284586 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e6c00d940 con 0x7f8e7c0f5920 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e83d7e700 1 -- 172.21.15.57:0/2746284586 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0f5920 msgr2=0x7f8e7c0f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e83d7e700 1 --2- 172.21.15.57:0/2746284586 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0f5920 0x7f8e7c0f1890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8e7c1037f0 tx=0x7f8e6c00ba50).stop 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e83d7e700 1 -- 172.21.15.57:0/2746284586 shutdown_connections 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e83d7e700 1 --2- 172.21.15.57:0/2746284586 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c0f2310 0x7f8e7c10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e83d7e700 1 --2- 172.21.15.57:0/2746284586 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0f5920 0x7f8e7c0f1890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.597 7f8e83d7e700 1 -- 172.21.15.57:0/2746284586 >> 172.21.15.57:0/2746284586 conn(0x7f8e7c113a70 msgr2=0x7f8e7c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:19.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.598 7f8e83d7e700 1 -- 172.21.15.57:0/2746284586 shutdown_connections 2024-04-25T02:06:19.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.598 7f8e83d7e700 1 -- 172.21.15.57:0/2746284586 wait complete. 2024-04-25T02:06:19.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.621 7f8e83d7e700 1 Processor -- start 2024-04-25T02:06:19.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.621 7f8e83d7e700 1 -- start start 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e83d7e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0cb950 0x7f8e7c0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e83d7e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e7c1b42a0 0x7f8e7c1b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e83d7e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c1b4d20 0x7f8e7c1bb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e83d7e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0cddc0 con 0x7f8e7c1b42a0 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e83d7e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0bc4c0 con 0x7f8e7c0cb950 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e83d7e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0cecd0 con 0x7f8e7c1b4d20 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e7bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e7c1b42a0 0x7f8e7c1b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e8137a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c1b4d20 0x7f8e7c1bb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e80b79700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0cb950 0x7f8e7c0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e8137a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c1b4d20 0x7f8e7c1bb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50554/0 (socket says 172.21.15.57:50554) 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e80b79700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0cb950 0x7f8e7c0cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49900/0 (socket says 172.21.15.57:49900) 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e7bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e7c1b42a0 0x7f8e7c1b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51074/0 (socket says 172.21.15.57:51074) 2024-04-25T02:06:19.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e8137a700 1 -- 172.21.15.57:0/380034751 learned_addr learned my addr 172.21.15.57:0/380034751 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e80b79700 1 -- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c1b4d20 msgr2=0x7f8e7c1bb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e80b79700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c1b4d20 0x7f8e7c1bb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e80b79700 1 -- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e7c1b42a0 msgr2=0x7f8e7c1b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e80b79700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e7c1b42a0 0x7f8e7c1b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e80b79700 1 -- 172.21.15.57:0/380034751 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c0ce080 con 0x7f8e7c0cb950 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e8137a700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c1b4d20 0x7f8e7c1bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.622 7f8e7bfff700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e7c1b42a0 0x7f8e7c1b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.623 7f8e80b79700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0cb950 0x7f8e7c0cbda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8e7c0c56e0 tx=0x7f8e6c0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.623 7f8e79ffb700 1 -- 172.21.15.57:0/380034751 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e7c0ce080 con 0x7f8e7c0cb950 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.623 7f8e79ffb700 1 -- 172.21.15.57:0/380034751 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c0117a0 con 0x7f8e7c0cb950 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.623 7f8e79ffb700 1 -- 172.21.15.57:0/380034751 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8e6c017040 con 0x7f8e7c0cb950 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.623 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c1b5170 con 0x7f8e7c0cb950 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.623 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7c1bbf90 con 0x7f8e7c0cb950 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.623 7f8e79ffb700 1 -- 172.21.15.57:0/380034751 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8e6c011b70 con 0x7f8e7c0cb950 2024-04-25T02:06:19.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.623 7f8e79ffb700 1 -- 172.21.15.57:0/380034751 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f8e6c018070 con 0x7f8e7c0cb950 2024-04-25T02:06:19.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.624 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7c0f08e0 con 0x7f8e7c0cb950 2024-04-25T02:06:19.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.627 7f8e79ffb700 1 -- 172.21.15.57:0/380034751 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f8e6c011590 con 0x7f8e7c0cb950 2024-04-25T02:06:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.769 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e7c0e13d0 con 0x7f8e7c0cb950 2024-04-25T02:06:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.770 7f8e79ffb700 1 -- 172.21.15.57:0/380034751 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1702 (secure 0 0 0) 0x7f8e6c00d360 con 0x7f8e7c0cb950 2024-04-25T02:06:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:19.777 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:05:47.333033","modified":"2024-04-25 02:05:49.360768","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 >> v1:172.21.15.57:6816/43033 conn(0x7f8e600145b0 legacy=0x7f8e60016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0cb950 msgr2=0x7f8e7c0cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0cb950 0x7f8e7c0cbda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8e7c0c56e0 tx=0x7f8e6c0068c0).stop 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 shutdown_connections 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e7c1b4d20 0x7f8e7c1bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e7c0cb950 0x7f8e7c0cbda0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 --2- 172.21.15.57:0/380034751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e7c1b42a0 0x7f8e7c1b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 >> 172.21.15.57:0/380034751 conn(0x7f8e7c0c5d20 msgr2=0x7f8e7c0bdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:19.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 shutdown_connections 2024-04-25T02:06:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.771 7f8e83d7e700 1 -- 172.21.15.57:0/380034751 wait complete. 2024-04-25T02:06:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T02:06:19.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f0283ead700 1 Processor -- start 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f0283ead700 1 -- start start 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f0283ead700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c0f2090 0x7f027c1a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f0283ead700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f027c1a8c80 0x7f027c1ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f0283ead700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0f9230 con 0x7f027c0f5920 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f0283ead700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c0f24e0 con 0x7f027c1a8c80 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f0283ead700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0f26e0 con 0x7f027c0f2090 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f02814a9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f027c1a8c80 0x7f027c1ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f027bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c0f2090 0x7f027c1a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f02814a9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f027c1a8c80 0x7f027c1ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51082/0 (socket says 172.21.15.57:51082) 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f027bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c0f2090 0x7f027c1a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50556/0 (socket says 172.21.15.57:50556) 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.914 7f02814a9700 1 -- 172.21.15.57:0/3222903794 learned_addr learned my addr 172.21.15.57:0/3222903794 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f02814a9700 1 -- 172.21.15.57:0/3222903794 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c0f2090 msgr2=0x7f027c1a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f02814a9700 1 --2- 172.21.15.57:0/3222903794 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c0f2090 0x7f027c1a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f02814a9700 1 -- 172.21.15.57:0/3222903794 >> v1:172.21.15.57:6789/0 conn(0x7f027c0f5920 legacy=0x7f027c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f027b7fe700 1 -- 172.21.15.57:0/3222903794 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635676202 0 0) 0x7f026c001110 con 0x7f027c0f5920 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f02814a9700 1 -- 172.21.15.57:0/3222903794 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c1ac720 con 0x7f027c1a8c80 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f027bfff700 1 --2- 172.21.15.57:0/3222903794 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c0f2090 0x7f027c1a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f02814a9700 1 --2- 172.21.15.57:0/3222903794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c1a8c80 0x7f027c1ab0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f02740032f0 tx=0x7f0274009de0).ready entity=mon.0 client_cookie=1dce97e4557235c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f027b7fe700 1 -- 172.21.15.57:0/3222903794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f027c1ac720 con 0x7f027c1a8c80 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f027b7fe700 1 -- 172.21.15.57:0/3222903794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400b870 con 0x7f027c1a8c80 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f027b7fe700 1 -- 172.21.15.57:0/3222903794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f027400ba50 con 0x7f027c1a8c80 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f0283ead700 1 -- 172.21.15.57:0/3222903794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c1a8c80 msgr2=0x7f027c1ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.915 7f0283ead700 1 --2- 172.21.15.57:0/3222903794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c1a8c80 0x7f027c1ab0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f02740032f0 tx=0x7f0274009de0).stop 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.916 7f0283ead700 1 -- 172.21.15.57:0/3222903794 shutdown_connections 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.916 7f0283ead700 1 --2- 172.21.15.57:0/3222903794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c1a8c80 0x7f027c1ab0e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.916 7f0283ead700 1 --2- 172.21.15.57:0/3222903794 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c0f2090 0x7f027c1a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.916 7f0283ead700 1 -- 172.21.15.57:0/3222903794 >> 172.21.15.57:0/3222903794 conn(0x7f027c113a70 msgr2=0x7f027c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.916 7f0283ead700 1 -- 172.21.15.57:0/3222903794 shutdown_connections 2024-04-25T02:06:19.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.916 7f0283ead700 1 -- 172.21.15.57:0/3222903794 wait complete. 2024-04-25T02:06:19.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.939 7f0283ead700 1 Processor -- start 2024-04-25T02:06:19.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.939 7f0283ead700 1 -- start start 2024-04-25T02:06:19.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0283ead700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c0c7300 0x7f027c1a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0283ead700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c1a44e0 0x7f027c1b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0283ead700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f027c1a4930 0x7f027c1b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:19.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0283ead700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0d7930 con 0x7f027c0c7300 2024-04-25T02:06:19.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0283ead700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1b5430 con 0x7f027c1a4930 2024-04-25T02:06:19.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0283ead700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f027c1b5660 con 0x7f027c1a44e0 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f027bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c1a44e0 0x7f027c1b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0280ca8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c0c7300 0x7f027c1a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f027bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c1a44e0 0x7f027c1b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50570/0 (socket says 172.21.15.57:50570) 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f027bfff700 1 -- 172.21.15.57:0/719160418 learned_addr learned my addr 172.21.15.57:0/719160418 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f02814a9700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f027c1a4930 0x7f027c1b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0280ca8700 1 -- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c1a44e0 msgr2=0x7f027c1b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0280ca8700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c1a44e0 0x7f027c1b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0280ca8700 1 -- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f027c1a4930 msgr2=0x7f027c1b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0280ca8700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f027c1a4930 0x7f027c1b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f0280ca8700 1 -- 172.21.15.57:0/719160418 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0f0200 con 0x7f027c0c7300 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.940 7f027bfff700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c1a44e0 0x7f027c1b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.941 7f0280ca8700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c0c7300 0x7f027c1a3eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f026c000ed0 tx=0x7f026c00c830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.941 7f0279ffb700 1 -- 172.21.15.57:0/719160418 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f027c0f0200 con 0x7f027c0c7300 2024-04-25T02:06:19.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.941 7f0279ffb700 1 -- 172.21.15.57:0/719160418 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00f470 con 0x7f027c0c7300 2024-04-25T02:06:19.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.941 7f0283ead700 1 -- 172.21.15.57:0/719160418 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c1bbec0 con 0x7f027c0c7300 2024-04-25T02:06:19.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.941 7f0279ffb700 1 -- 172.21.15.57:0/719160418 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f026c00f840 con 0x7f027c0c7300 2024-04-25T02:06:19.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.941 7f0283ead700 1 -- 172.21.15.57:0/719160418 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c1bc2a0 con 0x7f027c0c7300 2024-04-25T02:06:19.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.941 7f0279ffb700 1 -- 172.21.15.57:0/719160418 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f026c00fa40 con 0x7f027c0c7300 2024-04-25T02:06:19.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.941 7f0279ffb700 1 -- 172.21.15.57:0/719160418 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f026c014d20 con 0x7f027c0c7300 2024-04-25T02:06:19.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.942 7f0283ead700 1 -- 172.21.15.57:0/719160418 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c0f08e0 con 0x7f027c0c7300 2024-04-25T02:06:19.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:19.945 7f0279ffb700 1 -- 172.21.15.57:0/719160418 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f026c00f260 con 0x7f027c0c7300 2024-04-25T02:06:20.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.086 7f0283ead700 1 -- 172.21.15.57:0/719160418 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f027c0e2430 con 0x7f027c0c7300 2024-04-25T02:06:20.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.087 7f0279ffb700 1 -- 172.21.15.57:0/719160418 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+1702 (secure 0 0 0) 0x7f026c000c30 con 0x7f027c0c7300 2024-04-25T02:06:20.094 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:20.094 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:05:47.333033","modified":"2024-04-25 02:05:49.360768","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6817/2179885968","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":2179885968}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:06:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 -- 172.21.15.57:0/719160418 >> v1:172.21.15.57:6816/43033 conn(0x7f02600145b0 legacy=0x7f0260016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 -- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c0c7300 msgr2=0x7f027c1a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c0c7300 0x7f027c1a3eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f026c000ed0 tx=0x7f026c00c830).stop 2024-04-25T02:06:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 -- 172.21.15.57:0/719160418 shutdown_connections 2024-04-25T02:06:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f027c1a4930 0x7f027c1b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f027c0c7300 0x7f027c1a3eb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 --2- 172.21.15.57:0/719160418 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f027c1a44e0 0x7f027c1b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 -- 172.21.15.57:0/719160418 >> 172.21.15.57:0/719160418 conn(0x7f027c1a7c20 msgr2=0x7f027c0da9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:20.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 -- 172.21.15.57:0/719160418 shutdown_connections 2024-04-25T02:06:20.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.088 7f0283ead700 1 -- 172.21.15.57:0/719160418 wait complete. 2024-04-25T02:06:20.096 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T02:06:20.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:20.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.230 7fc32efed700 1 Processor -- start 2024-04-25T02:06:20.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.230 7fc32efed700 1 -- start start 2024-04-25T02:06:20.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc32efed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3280f58a0 0x7fc32810c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc32efed700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc32810cd40 0x7fc3280f2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc32efed700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280f2640 con 0x7fc32810c8f0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc32efed700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280fa210 con 0x7fc32810cd40 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc32efed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280f9540 con 0x7fc3280f58a0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc327fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc32810cd40 0x7fc3280f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc3277fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3280f58a0 0x7fc32810c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc326ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc32810c8f0 0x7fc3280f1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47376/0 (socket says 172.21.15.57:47376) 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc326ffd700 1 -- 172.21.15.57:0/2075611993 learned_addr learned my addr 172.21.15.57:0/2075611993 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc3277fe700 1 -- 172.21.15.57:0/2075611993 >> v2:172.21.15.57:3300/0 conn(0x7fc32810cd40 msgr2=0x7fc3280f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc3277fe700 1 --2- 172.21.15.57:0/2075611993 >> v2:172.21.15.57:3300/0 conn(0x7fc32810cd40 0x7fc3280f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc3277fe700 1 -- 172.21.15.57:0/2075611993 >> v1:172.21.15.57:6789/0 conn(0x7fc32810c8f0 legacy=0x7fc3280f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc3277fe700 1 -- 172.21.15.57:0/2075611993 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3281aa560 con 0x7fc3280f58a0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc327fff700 1 --2- 172.21.15.57:0/2075611993 >> v2:172.21.15.57:3300/0 conn(0x7fc32810cd40 0x7fc3280f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.231 7fc3277fe700 1 --2- 172.21.15.57:0/2075611993 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3280f58a0 0x7fc32810c2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc318002f70 tx=0x7fc31800b970).ready entity=mon.2 client_cookie=760586c77192cd79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc3267fc700 1 -- 172.21.15.57:0/2075611993 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3281aa560 con 0x7fc3280f58a0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc3267fc700 1 -- 172.21.15.57:0/2075611993 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800d5c0 con 0x7fc3280f58a0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc3267fc700 1 -- 172.21.15.57:0/2075611993 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc31800d990 con 0x7fc3280f58a0 2024-04-25T02:06:20.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc32efed700 1 -- 172.21.15.57:0/2075611993 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3280f58a0 msgr2=0x7fc32810c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc32efed700 1 --2- 172.21.15.57:0/2075611993 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3280f58a0 0x7fc32810c2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc318002f70 tx=0x7fc31800b970).stop 2024-04-25T02:06:20.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc32efed700 1 -- 172.21.15.57:0/2075611993 shutdown_connections 2024-04-25T02:06:20.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc32efed700 1 --2- 172.21.15.57:0/2075611993 >> v2:172.21.15.57:3300/0 conn(0x7fc32810cd40 0x7fc3280f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc32efed700 1 --2- 172.21.15.57:0/2075611993 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3280f58a0 0x7fc32810c2c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc32efed700 1 -- 172.21.15.57:0/2075611993 >> 172.21.15.57:0/2075611993 conn(0x7fc3281139f0 msgr2=0x7fc3280f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:20.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc32efed700 1 -- 172.21.15.57:0/2075611993 shutdown_connections 2024-04-25T02:06:20.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.232 7fc32efed700 1 -- 172.21.15.57:0/2075611993 wait complete. 2024-04-25T02:06:20.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.256 7fc32efed700 1 Processor -- start 2024-04-25T02:06:20.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.256 7fc32efed700 1 -- start start 2024-04-25T02:06:20.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc32efed700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3281ab2b0 0x7fc3281ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc32efed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3281abd30 0x7fc3281b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc32efed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3281b2330 0x7fc3281b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc32efed700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328088f60 con 0x7fc3281ab2b0 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc32efed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280dfc40 con 0x7fc3281b2330 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc32efed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280da8e0 con 0x7fc3281abd30 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3281ab2b0 0x7fc3281ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc326ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3281abd30 0x7fc3281b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3281ab2b0 0x7fc3281ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51106/0 (socket says 172.21.15.57:51106) 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 -- 172.21.15.57:0/3078209067 learned_addr learned my addr 172.21.15.57:0/3078209067 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc327fff700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3281b2330 0x7fc3281b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 -- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3281abd30 msgr2=0x7fc3281b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3281abd30 0x7fc3281b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 -- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3281b2330 msgr2=0x7fc3281b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3281b2330 0x7fc3281b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 -- 172.21.15.57:0/3078209067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280c4310 con 0x7fc3281ab2b0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc327fff700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3281b2330 0x7fc3281b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc3277fe700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3281ab2b0 0x7fc3281ab700 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fc3280cb560 tx=0x7fc3180068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.257 7fc324ff9700 1 -- 172.21.15.57:0/3078209067 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc318017040 con 0x7fc3281ab2b0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.258 7fc324ff9700 1 -- 172.21.15.57:0/3078209067 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3180119a0 con 0x7fc3281ab2b0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.258 7fc32efed700 1 -- 172.21.15.57:0/3078209067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280df470 con 0x7fc3281ab2b0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.258 7fc324ff9700 1 -- 172.21.15.57:0/3078209067 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc318011d70 con 0x7fc3281ab2b0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.258 7fc32efed700 1 -- 172.21.15.57:0/3078209067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3281b9650 con 0x7fc3281ab2b0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.258 7fc324ff9700 1 -- 172.21.15.57:0/3078209067 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc3180273b0 con 0x7fc3281ab2b0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.258 7fc324ff9700 1 -- 172.21.15.57:0/3078209067 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc318018070 con 0x7fc3281ab2b0 2024-04-25T02:06:20.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.259 7fc32efed700 1 -- 172.21.15.57:0/3078209067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3280f0860 con 0x7fc3281ab2b0 2024-04-25T02:06:20.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.262 7fc324ff9700 1 -- 172.21.15.57:0/3078209067 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc31800d3b0 con 0x7fc3281ab2b0 2024-04-25T02:06:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.373 7fc32efed700 1 -- 172.21.15.57:0/3078209067 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3281ac420 con 0x7fc3281ab2b0 2024-04-25T02:06:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.374 7fc324ff9700 1 -- 172.21.15.57:0/3078209067 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8732 (secure 0 0 0) 0x7fc318011790 con 0x7fc3281ab2b0 2024-04-25T02:06:20.381 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:20.381 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:03.810910","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:05:45.808052","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25 02:05:46.304771","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:20.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 -- 172.21.15.57:0/3078209067 >> v1:172.21.15.57:6816/43033 conn(0x7fc30c0145b0 legacy=0x7fc30c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 -- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3281ab2b0 msgr2=0x7fc3281ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3281ab2b0 0x7fc3281ab700 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fc3280cb560 tx=0x7fc3180068c0).stop 2024-04-25T02:06:20.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 -- 172.21.15.57:0/3078209067 shutdown_connections 2024-04-25T02:06:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3281b2330 0x7fc3281b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3281ab2b0 0x7fc3281ab700 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 --2- 172.21.15.57:0/3078209067 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc3281abd30 0x7fc3281b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 -- 172.21.15.57:0/3078209067 >> 172.21.15.57:0/3078209067 conn(0x7fc3281a5100 msgr2=0x7fc3280d6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 -- 172.21.15.57:0/3078209067 shutdown_connections 2024-04-25T02:06:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.375 7fc32efed700 1 -- 172.21.15.57:0/3078209067 wait complete. 2024-04-25T02:06:20.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:06:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.519 7f48960aa700 1 Processor -- start 2024-04-25T02:06:20.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.519 7f48960aa700 1 -- start start 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.519 7f48960aa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48900f5980 0x7f489010b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.519 7f48960aa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f489010b6b0 0x7f489019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.519 7f48960aa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48901a09e0 con 0x7f489010bb00 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.519 7f48960aa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900fa500 con 0x7f48900f5980 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f48960aa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48901a0c00 con 0x7f489010b6b0 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488edc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48900f5980 0x7f489010b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f48865c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f489010b6b0 0x7f489019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488edc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48900f5980 0x7f489010b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49936/0 (socket says 172.21.15.57:49936) 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f48865c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f489010b6b0 0x7f489019fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50592/0 (socket says 172.21.15.57:50592) 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488edc6700 1 -- 172.21.15.57:0/3856379843 learned_addr learned my addr 172.21.15.57:0/3856379843 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488edc6700 1 -- 172.21.15.57:0/3856379843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f489010b6b0 msgr2=0x7f489019fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488edc6700 1 --2- 172.21.15.57:0/3856379843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f489010b6b0 0x7f489019fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488edc6700 1 -- 172.21.15.57:0/3856379843 >> v1:172.21.15.57:6789/0 conn(0x7f489010bb00 legacy=0x7f48901a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488edc6700 1 -- 172.21.15.57:0/3856379843 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48901a9340 con 0x7f48900f5980 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488e5c5700 1 -- 172.21.15.57:0/3856379843 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483983580 0 0) 0x7f4888001490 con 0x7f489010bb00 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f48865c5700 1 --2- 172.21.15.57:0/3856379843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f489010b6b0 0x7f489019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488edc6700 1 --2- 172.21.15.57:0/3856379843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48900f5980 0x7f489010b080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f489010c190 tx=0x7f4880009ab0).ready entity=mon.1 client_cookie=4ffad86efb44b5b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488e5c5700 1 -- 172.21.15.57:0/3856379843 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48901a9340 con 0x7f48900f5980 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488e5c5700 1 -- 172.21.15.57:0/3856379843 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488000f510 con 0x7f48900f5980 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f488e5c5700 1 -- 172.21.15.57:0/3856379843 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f488000f6f0 con 0x7f48900f5980 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f48960aa700 1 -- 172.21.15.57:0/3856379843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48900f5980 msgr2=0x7f489010b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.520 7f48960aa700 1 --2- 172.21.15.57:0/3856379843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48900f5980 0x7f489010b080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f489010c190 tx=0x7f4880009ab0).stop 2024-04-25T02:06:20.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.521 7f48960aa700 1 -- 172.21.15.57:0/3856379843 shutdown_connections 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.521 7f48960aa700 1 --2- 172.21.15.57:0/3856379843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48900f5980 0x7f489010b080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.521 7f48960aa700 1 --2- 172.21.15.57:0/3856379843 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f489010b6b0 0x7f489019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.521 7f48960aa700 1 -- 172.21.15.57:0/3856379843 >> 172.21.15.57:0/3856379843 conn(0x7f48901139e0 msgr2=0x7f48900f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.521 7f48960aa700 1 -- 172.21.15.57:0/3856379843 shutdown_connections 2024-04-25T02:06:20.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.521 7f48960aa700 1 -- 172.21.15.57:0/3856379843 wait complete. 2024-04-25T02:06:20.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.545 7f48960aa700 1 Processor -- start 2024-04-25T02:06:20.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.545 7f48960aa700 1 -- start start 2024-04-25T02:06:20.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.545 7f48960aa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48900d6f50 0x7f48901b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.545 7f48960aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901b2df0 0x7f48900bde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.545 7f48960aa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48901b3240 0x7f48900be450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48960aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900cdfd0 con 0x7f48901b2df0 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48960aa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900bea80 con 0x7f48901b3240 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48960aa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48900becb0 con 0x7f48900d6f50 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48865c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901b2df0 0x7f48900bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48865c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901b2df0 0x7f48900bde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51112/0 (socket says 172.21.15.57:51112) 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48865c5700 1 -- 172.21.15.57:0/2620774942 learned_addr learned my addr 172.21.15.57:0/2620774942 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488f5c7700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48901b3240 0x7f48900be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488edc6700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48900d6f50 0x7f48901b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488edc6700 1 -- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48901b3240 msgr2=0x7f48900be450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488edc6700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48901b3240 0x7f48900be450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488edc6700 1 -- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901b2df0 msgr2=0x7f48900bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488edc6700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901b2df0 0x7f48900bde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488edc6700 1 -- 172.21.15.57:0/2620774942 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48901b9a10 con 0x7f48900d6f50 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48865c5700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901b2df0 0x7f48900bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488edc6700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48900d6f50 0x7f48901b27c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f48900e12a0 tx=0x7f48800068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488cdc2700 1 -- 172.21.15.57:0/2620774942 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48901b9a10 con 0x7f48900d6f50 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488cdc2700 1 -- 172.21.15.57:0/2620774942 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800119c0 con 0x7f48900d6f50 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48960aa700 1 -- 172.21.15.57:0/2620774942 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48901b9c10 con 0x7f48900d6f50 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f488cdc2700 1 -- 172.21.15.57:0/2620774942 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4880011d90 con 0x7f48900d6f50 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.546 7f48960aa700 1 -- 172.21.15.57:0/2620774942 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48901b9ff0 con 0x7f48900d6f50 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.547 7f488cdc2700 1 -- 172.21.15.57:0/2620774942 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4880027460 con 0x7f48900d6f50 2024-04-25T02:06:20.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.547 7f488cdc2700 1 -- 172.21.15.57:0/2620774942 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f48800016b0 con 0x7f48900d6f50 2024-04-25T02:06:20.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.547 7f48960aa700 1 -- 172.21.15.57:0/2620774942 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48900f0850 con 0x7f48900d6f50 2024-04-25T02:06:20.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.551 7f488cdc2700 1 -- 172.21.15.57:0/2620774942 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f48800117b0 con 0x7f48900d6f50 2024-04-25T02:06:20.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.694 7f48960aa700 1 -- 172.21.15.57:0/2620774942 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f48900e2430 con 0x7f48900d6f50 2024-04-25T02:06:20.819 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-04-25 02:06:20.813 7f21646cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:06:20.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.831 7f488cdc2700 1 -- 172.21.15.57:0/2620774942 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7f488000f300 con 0x7f48900d6f50 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 -- 172.21.15.57:0/2620774942 >> v1:172.21.15.57:6816/43033 conn(0x7f48740145b0 legacy=0x7f4874016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 -- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48900d6f50 msgr2=0x7f48901b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48900d6f50 0x7f48901b27c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f48900e12a0 tx=0x7f48800068c0).stop 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 -- 172.21.15.57:0/2620774942 shutdown_connections 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f48901b3240 0x7f48900be450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f48900d6f50 0x7f48901b27c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 --2- 172.21.15.57:0/2620774942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901b2df0 0x7f48900bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 -- 172.21.15.57:0/2620774942 >> 172.21.15.57:0/2620774942 conn(0x7f48900c5bc0 msgr2=0x7f48900c0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:20.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 -- 172.21.15.57:0/2620774942 shutdown_connections 2024-04-25T02:06:20.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.833 7f48960aa700 1 -- 172.21.15.57:0/2620774942 wait complete. 2024-04-25T02:06:20.841 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:06:20.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:06:20.865 INFO:tasks.ceph.mds.a.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:06:20.917 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-04-25T02:06:20.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.979 7fec52f55700 1 Processor -- start 2024-04-25T02:06:20.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.979 7fec52f55700 1 -- start start 2024-04-25T02:06:20.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec52f55700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c0f59f0 0x7fec4c10b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec52f55700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c10b720 0x7fec4c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec52f55700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c1a0a50 con 0x7fec4c10bb70 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec52f55700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0fa570 con 0x7fec4c0f59f0 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec52f55700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c1a0c70 con 0x7fec4c10b720 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec43fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c10b720 0x7fec4c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec4b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c0f59f0 0x7fec4c10b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec43fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c10b720 0x7fec4c19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50626/0 (socket says 172.21.15.57:50626) 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec4b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c0f59f0 0x7fec4c10b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49958/0 (socket says 172.21.15.57:49958) 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec43fff700 1 -- 172.21.15.57:0/1530058912 learned_addr learned my addr 172.21.15.57:0/1530058912 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec4b7fe700 1 -- 172.21.15.57:0/1530058912 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c10b720 msgr2=0x7fec4c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec4b7fe700 1 --2- 172.21.15.57:0/1530058912 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c10b720 0x7fec4c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec4b7fe700 1 -- 172.21.15.57:0/1530058912 >> v1:172.21.15.57:6789/0 conn(0x7fec4c10bb70 legacy=0x7fec4c1a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.980 7fec4affd700 1 -- 172.21.15.57:0/1530058912 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834519735 0 0) 0x7fec44001490 con 0x7fec4c10bb70 2024-04-25T02:06:20.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec4b7fe700 1 -- 172.21.15.57:0/1530058912 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c1a93b0 con 0x7fec4c0f59f0 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec43fff700 1 --2- 172.21.15.57:0/1530058912 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c10b720 0x7fec4c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec4b7fe700 1 --2- 172.21.15.57:0/1530058912 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c0f59f0 0x7fec4c10b0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fec4c10c200 tx=0x7fec3c00ba50).ready entity=mon.1 client_cookie=c217ec1b58bf6862 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec4affd700 1 -- 172.21.15.57:0/1530058912 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec4c1a93b0 con 0x7fec4c0f59f0 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec4affd700 1 -- 172.21.15.57:0/1530058912 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c00d570 con 0x7fec4c0f59f0 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec4affd700 1 -- 172.21.15.57:0/1530058912 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec3c00d940 con 0x7fec4c0f59f0 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec52f55700 1 -- 172.21.15.57:0/1530058912 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c0f59f0 msgr2=0x7fec4c10b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec52f55700 1 --2- 172.21.15.57:0/1530058912 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c0f59f0 0x7fec4c10b0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fec4c10c200 tx=0x7fec3c00ba50).stop 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec52f55700 1 -- 172.21.15.57:0/1530058912 shutdown_connections 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec52f55700 1 --2- 172.21.15.57:0/1530058912 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c0f59f0 0x7fec4c10b0f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec52f55700 1 --2- 172.21.15.57:0/1530058912 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c10b720 0x7fec4c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.981 7fec52f55700 1 -- 172.21.15.57:0/1530058912 >> 172.21.15.57:0/1530058912 conn(0x7fec4c113a50 msgr2=0x7fec4c0f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.982 7fec52f55700 1 -- 172.21.15.57:0/1530058912 shutdown_connections 2024-04-25T02:06:20.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:20.982 7fec52f55700 1 -- 172.21.15.57:0/1530058912 wait complete. 2024-04-25T02:06:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.005 7fec52f55700 1 Processor -- start 2024-04-25T02:06:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec52f55700 1 -- start start 2024-04-25T02:06:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec52f55700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c0d6580 0x7fec4c0d69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec52f55700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c1b0e20 0x7fec4c1b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:21.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec52f55700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec4c1b18a0 0x7fec4c1b8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec52f55700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0a2690 con 0x7fec4c1b18a0 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec52f55700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0cdec0 con 0x7fec4c1b0e20 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec52f55700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0d7000 con 0x7fec4c0d6580 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c0d6580 0x7fec4c0d69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec43fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c1b0e20 0x7fec4c1b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c0d6580 0x7fec4c0d69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50636/0 (socket says 172.21.15.57:50636) 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 -- 172.21.15.57:0/3533705952 learned_addr learned my addr 172.21.15.57:0/3533705952 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4bfff700 1 --2- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec4c1b18a0 0x7fec4c1b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 -- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c1b0e20 msgr2=0x7fec4c1b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 --2- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c1b0e20 0x7fec4c1b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 -- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec4c1b18a0 msgr2=0x7fec4c1b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 --2- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec4c1b18a0 0x7fec4c1b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 -- 172.21.15.57:0/3533705952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0c46c0 con 0x7fec4c0d6580 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.006 7fec4b7fe700 1 --2- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c0d6580 0x7fec4c0d69d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fec4c0c9460 tx=0x7fec3c0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.007 7fec497fa700 1 -- 172.21.15.57:0/3533705952 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec3c017040 con 0x7fec4c0d6580 2024-04-25T02:06:21.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.007 7fec497fa700 1 -- 172.21.15.57:0/3533705952 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c019730 con 0x7fec4c0d6580 2024-04-25T02:06:21.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.007 7fec52f55700 1 -- 172.21.15.57:0/3533705952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c1b1cf0 con 0x7fec4c0d6580 2024-04-25T02:06:21.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.007 7fec497fa700 1 -- 172.21.15.57:0/3533705952 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec3c019b00 con 0x7fec4c0d6580 2024-04-25T02:06:21.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.007 7fec52f55700 1 -- 172.21.15.57:0/3533705952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c0ce700 con 0x7fec4c0d6580 2024-04-25T02:06:21.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.007 7fec497fa700 1 -- 172.21.15.57:0/3533705952 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fec3c019d00 con 0x7fec4c0d6580 2024-04-25T02:06:21.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.007 7fec497fa700 1 -- 172.21.15.57:0/3533705952 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3237+0+0 (secure 0 0 0) 0x7fec3c018030 con 0x7fec4c0d6580 2024-04-25T02:06:21.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.008 7fec52f55700 1 -- 172.21.15.57:0/3533705952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c0cea50 con 0x7fec4c0d6580 2024-04-25T02:06:21.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.011 7fec497fa700 1 -- 172.21.15.57:0/3533705952 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fec3c00d360 con 0x7fec4c0d6580 2024-04-25T02:06:21.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.154 7fec52f55700 1 -- 172.21.15.57:0/3533705952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fec4c0f08c0 con 0x7fec4c0d6580 2024-04-25T02:06:21.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.835 7fec497fa700 1 -- 172.21.15.57:0/3533705952 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fec3c019520 con 0x7fec4c0d6580 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 -- 172.21.15.57:0/3533705952 >> v1:172.21.15.57:6816/43033 conn(0x7fec30014540 legacy=0x7fec30016a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 -- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c0d6580 msgr2=0x7fec4c0d69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 --2- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c0d6580 0x7fec4c0d69d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fec4c0c9460 tx=0x7fec3c0068c0).stop 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 -- 172.21.15.57:0/3533705952 shutdown_connections 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 --2- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec4c1b18a0 0x7fec4c1b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 --2- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec4c0d6580 0x7fec4c0d69d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 --2- 172.21.15.57:0/3533705952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec4c1b0e20 0x7fec4c1b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 -- 172.21.15.57:0/3533705952 >> 172.21.15.57:0/3533705952 conn(0x7fec4c0c8db0 msgr2=0x7fec4c0c3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 -- 172.21.15.57:0/3533705952 shutdown_connections 2024-04-25T02:06:21.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:21.837 7fec52f55700 1 -- 172.21.15.57:0/3533705952 wait complete. 2024-04-25T02:06:21.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:06:22.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.039 7fbe74ab9700 1 Processor -- start 2024-04-25T02:06:22.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe74ab9700 1 -- start start 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe74ab9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe7010b900 0x7fbe701a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe74ab9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701a59c0 0x7fbe701a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe74ab9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7010bd50 con 0x7fbe700f5a00 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe74ab9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700fa580 con 0x7fbe7010b900 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe74ab9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe701a0c40 con 0x7fbe701a59c0 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe6d850700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbe700f5a00 0x7fbe7010b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47432/0 (socket says 172.21.15.57:47432) 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe6d850700 1 -- 172.21.15.57:0/1526343890 learned_addr learned my addr 172.21.15.57:0/1526343890 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe6e051700 1 --2- 172.21.15.57:0/1526343890 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701a59c0 0x7fbe701a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:22.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.040 7fbe6504f700 1 --2- 172.21.15.57:0/1526343890 >> v2:172.21.15.57:3300/0 conn(0x7fbe7010b900 0x7fbe701a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6e051700 1 -- 172.21.15.57:0/1526343890 >> v2:172.21.15.57:3300/0 conn(0x7fbe7010b900 msgr2=0x7fbe701a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6e051700 1 --2- 172.21.15.57:0/1526343890 >> v2:172.21.15.57:3300/0 conn(0x7fbe7010b900 0x7fbe701a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6e051700 1 -- 172.21.15.57:0/1526343890 >> v1:172.21.15.57:6789/0 conn(0x7fbe700f5a00 legacy=0x7fbe7010b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6d04f700 1 -- 172.21.15.57:0/1526343890 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443707580 0 0) 0x7fbe60001110 con 0x7fbe700f5a00 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6e051700 1 -- 172.21.15.57:0/1526343890 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe701a9460 con 0x7fbe701a59c0 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6504f700 1 --2- 172.21.15.57:0/1526343890 >> v2:172.21.15.57:3300/0 conn(0x7fbe7010b900 0x7fbe701a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6e051700 1 --2- 172.21.15.57:0/1526343890 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701a59c0 0x7fbe701a7e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fbe700f47b0 tx=0x7fbe68009cc0).ready entity=mon.2 client_cookie=44ecafd80a67a9bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6d04f700 1 -- 172.21.15.57:0/1526343890 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbe701a9460 con 0x7fbe701a59c0 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6d04f700 1 -- 172.21.15.57:0/1526343890 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6800b840 con 0x7fbe701a59c0 2024-04-25T02:06:22.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe6d04f700 1 -- 172.21.15.57:0/1526343890 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbe6800ba20 con 0x7fbe701a59c0 2024-04-25T02:06:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe74ab9700 1 -- 172.21.15.57:0/1526343890 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701a59c0 msgr2=0x7fbe701a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.041 7fbe74ab9700 1 --2- 172.21.15.57:0/1526343890 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701a59c0 0x7fbe701a7e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fbe700f47b0 tx=0x7fbe68009cc0).stop 2024-04-25T02:06:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.042 7fbe74ab9700 1 -- 172.21.15.57:0/1526343890 shutdown_connections 2024-04-25T02:06:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.042 7fbe74ab9700 1 --2- 172.21.15.57:0/1526343890 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701a59c0 0x7fbe701a7e20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.042 7fbe74ab9700 1 --2- 172.21.15.57:0/1526343890 >> v2:172.21.15.57:3300/0 conn(0x7fbe7010b900 0x7fbe701a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.042 7fbe74ab9700 1 -- 172.21.15.57:0/1526343890 >> 172.21.15.57:0/1526343890 conn(0x7fbe70113a60 msgr2=0x7fbe700f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.042 7fbe74ab9700 1 -- 172.21.15.57:0/1526343890 shutdown_connections 2024-04-25T02:06:22.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.042 7fbe74ab9700 1 -- 172.21.15.57:0/1526343890 wait complete. 2024-04-25T02:06:22.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.066 7fbe74ab9700 1 Processor -- start 2024-04-25T02:06:22.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.066 7fbe74ab9700 1 -- start start 2024-04-25T02:06:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe74ab9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe700d7880 0x7fbe700d7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe74ab9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe701b2180 0x7fbe701b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe74ab9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701b2c00 0x7fbe701b9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe74ab9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700f0140 con 0x7fbe701b2180 2024-04-25T02:06:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe74ab9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700d8300 con 0x7fbe700d7880 2024-04-25T02:06:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe74ab9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700cf570 con 0x7fbe701b2c00 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6d850700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe700d7880 0x7fbe700d7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe701b2180 0x7fbe701b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6e051700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701b2c00 0x7fbe701b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe701b2180 0x7fbe701b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51164/0 (socket says 172.21.15.57:51164) 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6d850700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe700d7880 0x7fbe700d7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49990/0 (socket says 172.21.15.57:49990) 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 -- 172.21.15.57:0/1623077363 learned_addr learned my addr 172.21.15.57:0/1623077363 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6e051700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701b2c00 0x7fbe701b9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50650/0 (socket says 172.21.15.57:50650) 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 -- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701b2c00 msgr2=0x7fbe701b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 --2- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701b2c00 0x7fbe701b9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 -- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe700d7880 msgr2=0x7fbe700d7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 --2- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe700d7880 0x7fbe700d7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 -- 172.21.15.57:0/1623077363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700df4c0 con 0x7fbe701b2180 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe6504f700 1 --2- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe701b2180 0x7fbe701b25d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fbe700c6520 tx=0x7fbe5800ecd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe677fe700 1 -- 172.21.15.57:0/1623077363 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbe700df4c0 con 0x7fbe701b2180 2024-04-25T02:06:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe677fe700 1 -- 172.21.15.57:0/1623077363 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800c9a0 con 0x7fbe701b2180 2024-04-25T02:06:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe700cef20 con 0x7fbe701b2180 2024-04-25T02:06:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.067 7fbe677fe700 1 -- 172.21.15.57:0/1623077363 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbe5800f040 con 0x7fbe701b2180 2024-04-25T02:06:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.068 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe700cfba0 con 0x7fbe701b2180 2024-04-25T02:06:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.068 7fbe677fe700 1 -- 172.21.15.57:0/1623077363 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fbe58011070 con 0x7fbe701b2180 2024-04-25T02:06:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.068 7fbe677fe700 1 -- 172.21.15.57:0/1623077363 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3237+0+0 (secure 0 0 0) 0x7fbe58010040 con 0x7fbe701b2180 2024-04-25T02:06:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.069 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe700f08d0 con 0x7fbe701b2180 2024-04-25T02:06:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.072 7fbe677fe700 1 -- 172.21.15.57:0/1623077363 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fbe5800c5a0 con 0x7fbe701b2180 2024-04-25T02:06:22.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.181 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe701ac8a0 con 0x7fbe701b2180 2024-04-25T02:06:22.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.851 7fbe677fe700 1 -- 172.21.15.57:0/1623077363 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v19) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbe58000c30 con 0x7fbe701b2180 2024-04-25T02:06:22.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.853 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 >> v1:172.21.15.57:6816/43033 conn(0x7fbe540145b0 legacy=0x7fbe54016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe701b2180 msgr2=0x7fbe701b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 --2- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe701b2180 0x7fbe701b25d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fbe700c6520 tx=0x7fbe5800ecd0).stop 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 shutdown_connections 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 --2- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe701b2c00 0x7fbe701b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 --2- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe700d7880 0x7fbe700d7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 --2- 172.21.15.57:0/1623077363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe701b2180 0x7fbe701b25d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 >> 172.21.15.57:0/1623077363 conn(0x7fbe700e04c0 msgr2=0x7fbe700f1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 shutdown_connections 2024-04-25T02:06:22.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:22.854 7fbe74ab9700 1 -- 172.21.15.57:0/1623077363 wait complete. 2024-04-25T02:06:22.871 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:06:22.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabe4822700 1 Processor -- start 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabe4822700 1 -- start start 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabe4822700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe00f5910 0x7fabe010c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabe4822700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe010c960 0x7fabe00f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabe4822700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fabe010cdb0 0x7fabe00f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabe4822700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe00fa280 con 0x7fabe010cdb0 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabe4822700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00f95b0 con 0x7fabe00f5910 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabe4822700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00f24e0 con 0x7fabe010c960 2024-04-25T02:06:23.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabdddfc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fabe010cdb0 0x7fabe00f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabdd5fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe00f5910 0x7fabe010c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabd7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe010c960 0x7fabe00f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabdddfc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fabe010cdb0 0x7fabe00f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51180/0 (socket says 172.21.15.57:51180) 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabdd5fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe00f5910 0x7fabe010c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50006/0 (socket says 172.21.15.57:50006) 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.023 7fabdddfc700 1 -- 172.21.15.57:0/1848821664 learned_addr learned my addr 172.21.15.57:0/1848821664 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabd7fff700 1 -- 172.21.15.57:0/1848821664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe00f5910 msgr2=0x7fabe010c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabd7fff700 1 --2- 172.21.15.57:0/1848821664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe00f5910 0x7fabe010c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabd7fff700 1 -- 172.21.15.57:0/1848821664 >> v2:172.21.15.57:3300/0 conn(0x7fabe010cdb0 msgr2=0x7fabe00f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabd7fff700 1 --2- 172.21.15.57:0/1848821664 >> v2:172.21.15.57:3300/0 conn(0x7fabe010cdb0 0x7fabe00f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabd7fff700 1 -- 172.21.15.57:0/1848821664 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00f2710 con 0x7fabe010c960 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabdddfc700 1 --2- 172.21.15.57:0/1848821664 >> v2:172.21.15.57:3300/0 conn(0x7fabe010cdb0 0x7fabe00f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabdd5fb700 1 --2- 172.21.15.57:0/1848821664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe00f5910 0x7fabe010c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabd7fff700 1 --2- 172.21.15.57:0/1848821664 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe010c960 0x7fabe00f1880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fabc8002f70 tx=0x7fabc800b970).ready entity=mon.2 client_cookie=5900c65a1fbb078e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabdcdfa700 1 -- 172.21.15.57:0/1848821664 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fabe00f2710 con 0x7fabe010c960 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabdcdfa700 1 -- 172.21.15.57:0/1848821664 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800d570 con 0x7fabe010c960 2024-04-25T02:06:23.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabdcdfa700 1 -- 172.21.15.57:0/1848821664 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fabc800d940 con 0x7fabe010c960 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabe4822700 1 -- 172.21.15.57:0/1848821664 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe010c960 msgr2=0x7fabe00f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.024 7fabe4822700 1 --2- 172.21.15.57:0/1848821664 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe010c960 0x7fabe00f1880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fabc8002f70 tx=0x7fabc800b970).stop 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.025 7fabe4822700 1 -- 172.21.15.57:0/1848821664 shutdown_connections 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.025 7fabe4822700 1 --2- 172.21.15.57:0/1848821664 >> v2:172.21.15.57:3300/0 conn(0x7fabe010cdb0 0x7fabe00f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.025 7fabe4822700 1 --2- 172.21.15.57:0/1848821664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe00f5910 0x7fabe010c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.025 7fabe4822700 1 --2- 172.21.15.57:0/1848821664 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe010c960 0x7fabe00f1880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.025 7fabe4822700 1 -- 172.21.15.57:0/1848821664 >> 172.21.15.57:0/1848821664 conn(0x7fabe0113a60 msgr2=0x7fabe00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.025 7fabe4822700 1 -- 172.21.15.57:0/1848821664 shutdown_connections 2024-04-25T02:06:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.025 7fabe4822700 1 -- 172.21.15.57:0/1848821664 wait complete. 2024-04-25T02:06:23.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabe4822700 1 Processor -- start 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabe4822700 1 -- start start 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabe4822700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabe01af130 0x7fabe01af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabe4822700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe01afbb0 0x7fabe01b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabe4822700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe01b2ae0 0x7fabe01b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabe4822700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00ce210 con 0x7fabe01af130 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabe4822700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00ce560 con 0x7fabe01b2ae0 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabe4822700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabe01b3560 con 0x7fabe01afbb0 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabdd5fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabe01af130 0x7fabe01af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabdddfc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe01b2ae0 0x7fabe01b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:23.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabdd5fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabe01af130 0x7fabe01af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51190/0 (socket says 172.21.15.57:51190) 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabdd5fb700 1 -- 172.21.15.57:0/3905500118 learned_addr learned my addr 172.21.15.57:0/3905500118 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabdddfc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe01b2ae0 0x7fabe01b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50014/0 (socket says 172.21.15.57:50014) 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.049 7fabd7fff700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe01afbb0 0x7fabe01b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabdddfc700 1 -- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe01afbb0 msgr2=0x7fabe01b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabdddfc700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe01afbb0 0x7fabe01b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabdddfc700 1 -- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabe01af130 msgr2=0x7fabe01af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabdddfc700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabe01af130 0x7fabe01af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabdddfc700 1 -- 172.21.15.57:0/3905500118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00cddf0 con 0x7fabe01b2ae0 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabdd5fb700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabe01af130 0x7fabe01af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabdddfc700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe01b2ae0 0x7fabe01b2f30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fabe00d7740 tx=0x7fabd800edd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabd67fc700 1 -- 172.21.15.57:0/3905500118 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fabe00cddf0 con 0x7fabe01b2ae0 2024-04-25T02:06:23.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabd67fc700 1 -- 172.21.15.57:0/3905500118 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800c7b0 con 0x7fabe01b2ae0 2024-04-25T02:06:23.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabe4822700 1 -- 172.21.15.57:0/3905500118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe00ce8f0 con 0x7fabe01b2ae0 2024-04-25T02:06:23.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabd67fc700 1 -- 172.21.15.57:0/3905500118 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fabd800f040 con 0x7fabe01b2ae0 2024-04-25T02:06:23.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabe4822700 1 -- 172.21.15.57:0/3905500118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe01b9b70 con 0x7fabe01b2ae0 2024-04-25T02:06:23.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.050 7fabd67fc700 1 -- 172.21.15.57:0/3905500118 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fabd8011070 con 0x7fabe01b2ae0 2024-04-25T02:06:23.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.051 7fabd67fc700 1 -- 172.21.15.57:0/3905500118 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2799+0+0 (secure 0 0 0) 0x7fabd8010040 con 0x7fabe01b2ae0 2024-04-25T02:06:23.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.051 7fabe4822700 1 -- 172.21.15.57:0/3905500118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe00f08d0 con 0x7fabe01b2ae0 2024-04-25T02:06:23.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.054 7fabd67fc700 1 -- 172.21.15.57:0/3905500118 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fabd800c5a0 con 0x7fabe01b2ae0 2024-04-25T02:06:23.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.163 7fabe4822700 1 -- 172.21.15.57:0/3905500118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fabe00e2400 con 0x7fabe01b2ae0 2024-04-25T02:06:23.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.858 7fabd67fc700 1 -- 172.21.15.57:0/3905500118 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v20) v1 ==== 169+0+0 (secure 0 0 0) 0x7fabe01145e0 con 0x7fabe01b2ae0 2024-04-25T02:06:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.864 7fabe4822700 1 -- 172.21.15.57:0/3905500118 >> v1:172.21.15.57:6816/43033 conn(0x7fabc40145b0 legacy=0x7fabc4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.864 7fabe4822700 1 -- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe01b2ae0 msgr2=0x7fabe01b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:23.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.864 7fabe4822700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe01b2ae0 0x7fabe01b2f30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fabe00d7740 tx=0x7fabd800edd0).stop 2024-04-25T02:06:23.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.869 7fabe4822700 1 -- 172.21.15.57:0/3905500118 shutdown_connections 2024-04-25T02:06:23.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.869 7fabe4822700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fabe01b2ae0 0x7fabe01b2f30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.869 7fabe4822700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fabe01af130 0x7fabe01af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.869 7fabe4822700 1 --2- 172.21.15.57:0/3905500118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fabe01afbb0 0x7fabe01b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:23.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.870 7fabe4822700 1 -- 172.21.15.57:0/3905500118 >> 172.21.15.57:0/3905500118 conn(0x7fabe00c8dd0 msgr2=0x7fabe00c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:23.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.870 7fabe4822700 1 -- 172.21.15.57:0/3905500118 shutdown_connections 2024-04-25T02:06:23.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:23.870 7fabe4822700 1 -- 172.21.15.57:0/3905500118 wait complete. 2024-04-25T02:06:23.880 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2024-04-25T02:06:23.898 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:06:23.899 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T02:06:23.899 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:06:23.899 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:06:23.908 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:06:23.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:06:23.951 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:06:23.951 DEBUG:teuthology.parallel:result is None 2024-04-25T02:06:23.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T02:06:24.029 INFO:tasks.ceph.mds.a.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:06:24.081 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-04-25T02:06:24.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.083 7f8229d8a700 1 Processor -- start 2024-04-25T02:06:24.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.083 7f8229d8a700 1 -- start start 2024-04-25T02:06:24.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8229d8a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240f5a00 0x7f822410b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8229d8a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f822410bb80 0x7f82241a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8229d8a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82241a0a60 con 0x7f822410b730 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8229d8a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82240fa580 con 0x7f822410bb80 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8229d8a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82241a0c80 con 0x7f82240f5a00 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8222ab2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240f5a00 0x7f822410b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f82232b3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f822410bb80 0x7f82241a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8222ab2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240f5a00 0x7f822410b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50686/0 (socket says 172.21.15.57:50686) 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f82222b1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f822410b730 0x7f822419fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47452/0 (socket says 172.21.15.57:47452) 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f82232b3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f822410bb80 0x7f82241a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51198/0 (socket says 172.21.15.57:51198) 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8222ab2700 1 -- 172.21.15.57:0/1584447087 learned_addr learned my addr 172.21.15.57:0/1584447087 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8222ab2700 1 -- 172.21.15.57:0/1584447087 >> v2:172.21.15.57:3300/0 conn(0x7f822410bb80 msgr2=0x7f82241a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8222ab2700 1 --2- 172.21.15.57:0/1584447087 >> v2:172.21.15.57:3300/0 conn(0x7f822410bb80 0x7f82241a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8222ab2700 1 -- 172.21.15.57:0/1584447087 >> v1:172.21.15.57:6789/0 conn(0x7f822410b730 legacy=0x7f822419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8221ab0700 1 -- 172.21.15.57:0/1584447087 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050445216 0 0) 0x7f8218001110 con 0x7f822410b730 2024-04-25T02:06:24.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8222ab2700 1 -- 172.21.15.57:0/1584447087 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82241a93c0 con 0x7f82240f5a00 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.084 7f8222ab2700 1 --2- 172.21.15.57:0/1584447087 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240f5a00 0x7f822410b100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f82140032f0 tx=0x7f8214009d60).ready entity=mon.2 client_cookie=c784f030b3599caa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8221ab0700 1 -- 172.21.15.57:0/1584447087 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82241a93c0 con 0x7f82240f5a00 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8221ab0700 1 -- 172.21.15.57:0/1584447087 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821400ba70 con 0x7f82240f5a00 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8221ab0700 1 -- 172.21.15.57:0/1584447087 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8214010470 con 0x7f82240f5a00 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8229d8a700 1 -- 172.21.15.57:0/1584447087 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240f5a00 msgr2=0x7f822410b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8229d8a700 1 --2- 172.21.15.57:0/1584447087 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240f5a00 0x7f822410b100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f82140032f0 tx=0x7f8214009d60).stop 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8229d8a700 1 -- 172.21.15.57:0/1584447087 shutdown_connections 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8229d8a700 1 --2- 172.21.15.57:0/1584447087 >> v2:172.21.15.57:3300/0 conn(0x7f822410bb80 0x7f82241a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8229d8a700 1 --2- 172.21.15.57:0/1584447087 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240f5a00 0x7f822410b100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8229d8a700 1 -- 172.21.15.57:0/1584447087 >> 172.21.15.57:0/1584447087 conn(0x7f8224113a60 msgr2=0x7f82240f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8229d8a700 1 -- 172.21.15.57:0/1584447087 shutdown_connections 2024-04-25T02:06:24.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.085 7f8229d8a700 1 -- 172.21.15.57:0/1584447087 wait complete. 2024-04-25T02:06:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.109 7f8229d8a700 1 Processor -- start 2024-04-25T02:06:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.109 7f8229d8a700 1 -- start start 2024-04-25T02:06:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.109 7f8229d8a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82240d1af0 0x7f82240d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8229d8a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240d2570 0x7f82241b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8229d8a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82241b06d0 0x7f82241b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8229d8a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82240db8e0 con 0x7f82240d1af0 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8229d8a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82240d4290 con 0x7f82241b06d0 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8229d8a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82241b1150 con 0x7f82240d2570 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240d2570 0x7f82241b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82232b3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82241b06d0 0x7f82241b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8222ab2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82240d1af0 0x7f82240d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240d2570 0x7f82241b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50702/0 (socket says 172.21.15.57:50702) 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82232b3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82241b06d0 0x7f82241b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50030/0 (socket says 172.21.15.57:50030) 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8222ab2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82240d1af0 0x7f82240d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51212/0 (socket says 172.21.15.57:51212) 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 -- 172.21.15.57:0/300615317 learned_addr learned my addr 172.21.15.57:0/300615317 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 -- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82241b06d0 msgr2=0x7f82241b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82241b06d0 0x7f82241b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 -- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82240d1af0 msgr2=0x7f82240d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82240d1af0 0x7f82240d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 -- 172.21.15.57:0/300615317 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82240df390 con 0x7f82240d2570 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8222ab2700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82240d1af0 0x7f82240d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82232b3700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82241b06d0 0x7f82241b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f82222b1700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240d2570 0x7f82241b00a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f82240c4210 tx=0x7f821800c810).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8213fff700 1 -- 172.21.15.57:0/300615317 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82240df390 con 0x7f82240d2570 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8213fff700 1 -- 172.21.15.57:0/300615317 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82180072e0 con 0x7f82240d2570 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8229d8a700 1 -- 172.21.15.57:0/300615317 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82240df710 con 0x7f82240d2570 2024-04-25T02:06:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8213fff700 1 -- 172.21.15.57:0/300615317 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8218005750 con 0x7f82240d2570 2024-04-25T02:06:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.110 7f8229d8a700 1 -- 172.21.15.57:0/300615317 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82241b79f0 con 0x7f82240d2570 2024-04-25T02:06:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.111 7f8213fff700 1 -- 172.21.15.57:0/300615317 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f821801b070 con 0x7f82240d2570 2024-04-25T02:06:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.111 7f8213fff700 1 -- 172.21.15.57:0/300615317 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f8218013450 con 0x7f82240d2570 2024-04-25T02:06:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.111 7f8229d8a700 1 -- 172.21.15.57:0/300615317 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82240f08d0 con 0x7f82240d2570 2024-04-25T02:06:24.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.115 7f8213fff700 1 -- 172.21.15.57:0/300615317 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f82180070d0 con 0x7f82240d2570 2024-04-25T02:06:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.271 7f8229d8a700 1 -- 172.21.15.57:0/300615317 >> v1:172.21.15.57:6816/43033 conn(0x7f82000145b0 legacy=0x7f8200016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.271 7f8229d8a700 1 -- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240d2570 msgr2=0x7f82241b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.271 7f8229d8a700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240d2570 0x7f82241b00a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f82240c4210 tx=0x7f821800c810).stop 2024-04-25T02:06:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.272 7f8229d8a700 1 -- 172.21.15.57:0/300615317 shutdown_connections 2024-04-25T02:06:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.272 7f8229d8a700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82241b06d0 0x7f82241b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.272 7f8229d8a700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82240d1af0 0x7f82240d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.272 7f8229d8a700 1 --2- 172.21.15.57:0/300615317 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82240d2570 0x7f82241b00a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.272 7f8229d8a700 1 -- 172.21.15.57:0/300615317 >> 172.21.15.57:0/300615317 conn(0x7f82240e0520 msgr2=0x7f82241a10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.272 7f8229d8a700 1 -- 172.21.15.57:0/300615317 shutdown_connections 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.272 7f8229d8a700 1 -- 172.21.15.57:0/300615317 wait complete. 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:no valid command found; 10 closest matches: 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:osd perf 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:osd df {plain|tree} {class|name} {} 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:osd blocked-by 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool stats {} 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool scrub [...] 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool deep-scrub [...] 2024-04-25T02:06:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool repair [...] 2024-04-25T02:06:24.281 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool force-recovery [...] 2024-04-25T02:06:24.281 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool force-backfill [...] 2024-04-25T02:06:24.281 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool cancel-force-recovery [...] 2024-04-25T02:06:24.281 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: invalid command 2024-04-25T02:06:24.289 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T02:06:24.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0cb712700 1 Processor -- start 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0cb712700 1 -- start start 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0cb712700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0c410cac0 0x7fa0c41a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0cb712700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c41a6b60 0x7fa0c41a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0cb712700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c410cf10 con 0x7fa0c40f58a0 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0cb712700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40fa210 con 0x7fa0c410cac0 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0cb712700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40f9540 con 0x7fa0c41a6b60 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0c3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa0c40f58a0 0x7fa0c410c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47458/0 (socket says 172.21.15.57:47458) 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0c3fff700 1 -- 172.21.15.57:0/187391908 learned_addr learned my addr 172.21.15.57:0/187391908 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0c8d0e700 1 --2- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c41a6b60 0x7fa0c41a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.414 7fa0c37fe700 1 --2- 172.21.15.57:0/187391908 >> v2:172.21.15.57:3300/0 conn(0x7fa0c410cac0 0x7fa0c41a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c37fe700 1 -- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c41a6b60 msgr2=0x7fa0c41a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c2ffd700 1 -- 172.21.15.57:0/187391908 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094321733 0 0) 0x7fa0b4001110 con 0x7fa0c40f58a0 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c37fe700 1 --2- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c41a6b60 0x7fa0c41a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c37fe700 1 -- 172.21.15.57:0/187391908 >> v1:172.21.15.57:6789/0 conn(0x7fa0c40f58a0 legacy=0x7fa0c410c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c37fe700 1 -- 172.21.15.57:0/187391908 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c41aa600 con 0x7fa0c410cac0 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c8d0e700 1 --2- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c41a6b60 0x7fa0c41a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c37fe700 1 --2- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c410cac0 0x7fa0c41a6530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa0c4113380 tx=0x7fa0b800ba20).ready entity=mon.0 client_cookie=102e8d8c7fe4225d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c2ffd700 1 -- 172.21.15.57:0/187391908 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0c41aa600 con 0x7fa0c410cac0 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c2ffd700 1 -- 172.21.15.57:0/187391908 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b800d5c0 con 0x7fa0c410cac0 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0c2ffd700 1 -- 172.21.15.57:0/187391908 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0b800d990 con 0x7fa0c410cac0 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0cb712700 1 -- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c410cac0 msgr2=0x7fa0c41a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.415 7fa0cb712700 1 --2- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c410cac0 0x7fa0c41a6530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa0c4113380 tx=0x7fa0b800ba20).stop 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.416 7fa0cb712700 1 -- 172.21.15.57:0/187391908 shutdown_connections 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.416 7fa0cb712700 1 --2- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c41a6b60 0x7fa0c41a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.416 7fa0cb712700 1 --2- 172.21.15.57:0/187391908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c410cac0 0x7fa0c41a6530 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.416 7fa0cb712700 1 -- 172.21.15.57:0/187391908 >> 172.21.15.57:0/187391908 conn(0x7fa0c41139f0 msgr2=0x7fa0c40f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.416 7fa0cb712700 1 -- 172.21.15.57:0/187391908 shutdown_connections 2024-04-25T02:06:24.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.416 7fa0cb712700 1 -- 172.21.15.57:0/187391908 wait complete. 2024-04-25T02:06:24.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0cb712700 1 Processor -- start 2024-04-25T02:06:24.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0cb712700 1 -- start start 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0cb712700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40f68f0 0x7fa0c40d83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0cb712700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c40d8a10 0x7fa0c41b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0cb712700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c40d8e60 0x7fa0c41b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0cb712700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40f01d0 con 0x7fa0c40f68f0 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0cb712700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40f7340 con 0x7fa0c40d8e60 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0cb712700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41b4e30 con 0x7fa0c40d8a10 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0c3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40f68f0 0x7fa0c40d83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0c3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40f68f0 0x7fa0c40d83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51242/0 (socket says 172.21.15.57:51242) 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0c8d0e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c40d8e60 0x7fa0c41b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0c3fff700 1 -- 172.21.15.57:0/2669441189 learned_addr learned my addr 172.21.15.57:0/2669441189 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.440 7fa0c37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c40d8a10 0x7fa0c41b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c8d0e700 1 -- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c40d8a10 msgr2=0x7fa0c41b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c8d0e700 1 --2- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c40d8a10 0x7fa0c41b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c8d0e700 1 -- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40f68f0 msgr2=0x7fa0c40d83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c8d0e700 1 --2- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40f68f0 0x7fa0c40d83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c8d0e700 1 -- 172.21.15.57:0/2669441189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c41b5060 con 0x7fa0c40d8e60 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c3fff700 1 --2- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40f68f0 0x7fa0c40d83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c8d0e700 1 --2- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c40d8e60 0x7fa0c41b4800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa0c41a94e0 tx=0x7fa0bc00ed40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c17fa700 1 -- 172.21.15.57:0/2669441189 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0c41b5060 con 0x7fa0c40d8e60 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c17fa700 1 -- 172.21.15.57:0/2669441189 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc00c880 con 0x7fa0c40d8e60 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c41bb8c0 con 0x7fa0c40d8e60 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c17fa700 1 -- 172.21.15.57:0/2669441189 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0bc00f040 con 0x7fa0c40d8e60 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c41bbca0 con 0x7fa0c40d8e60 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c17fa700 1 -- 172.21.15.57:0/2669441189 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa0bc022060 con 0x7fa0c40d8e60 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.441 7fa0c17fa700 1 -- 172.21.15.57:0/2669441189 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fa0bc010040 con 0x7fa0c40d8e60 2024-04-25T02:06:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.442 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c40f0860 con 0x7fa0c40d8e60 2024-04-25T02:06:24.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.445 7fa0c17fa700 1 -- 172.21.15.57:0/2669441189 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa0bc00c670 con 0x7fa0c40d8e60 2024-04-25T02:06:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.559 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa0c40a61a0 con 0x7fa0c40d8e60 2024-04-25T02:06:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.560 7fa0c17fa700 1 -- 172.21.15.57:0/2669441189 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+11815 (secure 0 0 0) 0x7fa0c4114570 con 0x7fa0c40d8e60 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 20, 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "f8b8656c-c3d2-4264-b256-59947e4191e7", 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-04-25 02:05:27.625638", 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-04-25 02:06:23.850624", 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2024-04-25 02:05:33.696326", 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2024-04-25 02:05:33.696326", 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2024-04-25T02:06:24.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 4, 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 3, 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 4, 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "nautilus", 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2024-04-25T02:06:24.568 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "nautilus", 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25 02:05:37.065200", 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T02:06:24.569 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "12", 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T02:06:24.570 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T02:06:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T02:06:24.572 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.573 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "ddbfde7d-6964-42f8-931b-4c4181565274", 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 9, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 14, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43631 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43631 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43631 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2024-04-25T02:06:24.576 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43631 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6812/43631", 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6813/43631", 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/43631", 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6814/43631", 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T02:06:24.577 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "76399db5-6fb7-4f04-9c9f-b35ff68a8d56", 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 9, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 14, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43629 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43629 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43629 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2024-04-25T02:06:24.580 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43629 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6804/43629", 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6805/43629", 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/43629", 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6806/43629", 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T02:06:24.581 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f0f51faf-c079-4f62-80db-dbec64d28887", 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 9, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 14, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.582 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43633 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43633 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43633 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2024-04-25T02:06:24.584 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43633 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6800/43633", 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6801/43633", 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6803/43633", 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6802/43633", 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2024-04-25T02:06:24.585 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "56f7d9c7-7455-4936-91f1-96bbc0ff7d78", 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 9, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 14, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.586 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43632 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43632 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.587 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43632 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43632 2024-04-25T02:06:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6808/43632", 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6809/43632", 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6811/43632", 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6810/43632", 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.589 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4611087854035861503, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4611087854035861503, 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0 2024-04-25T02:06:24.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4611087854035861503, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4611087854035861503, 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0 2024-04-25T02:06:24.591 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6817/2179885968": "2024-04-26 02:06:20.696237" 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2024-04-25T02:06:24.592 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2024-04-25T02:06:24.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.593 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2024-04-25T02:06:24.593 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2024-04-25T02:06:24.593 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2024-04-25T02:06:24.593 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2024-04-25T02:06:24.593 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2024-04-25T02:06:24.593 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T02:06:24.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 >> v1:172.21.15.57:6816/43033 conn(0x7fa0a40145b0 legacy=0x7fa0a4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c40d8e60 msgr2=0x7fa0c41b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 --2- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c40d8e60 0x7fa0c41b4800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa0c41a94e0 tx=0x7fa0bc00ed40).stop 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 shutdown_connections 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 --2- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c40d8e60 0x7fa0c41b4800 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 --2- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40f68f0 0x7fa0c40d83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 --2- 172.21.15.57:0/2669441189 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0c40d8a10 0x7fa0c41b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 >> 172.21.15.57:0/2669441189 conn(0x7fa0c40cb080 msgr2=0x7fa0c40c4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 shutdown_connections 2024-04-25T02:06:24.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.561 7fa0cb712700 1 -- 172.21.15.57:0/2669441189 wait complete. 2024-04-25T02:06:24.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-04-25T02:06:24.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.720 7fb50876f700 1 Processor -- start 2024-04-25T02:06:24.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.720 7fb50876f700 1 -- start start 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.720 7fb50876f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5000f5920 0x7fb50010c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.720 7fb50876f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb50010c970 0x7fb5000f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50876f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5000f26c0 con 0x7fb50010cdc0 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50876f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5000fa290 con 0x7fb50010c970 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50876f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5000f95c0 con 0x7fb5000f5920 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50556a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5000f5920 0x7fb50010c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb504d69700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb50010c970 0x7fb5000f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50556a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5000f5920 0x7fb50010c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50054/0 (socket says 172.21.15.57:50054) 2024-04-25T02:06:24.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb505d6b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb50010cdc0 0x7fb5000f1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47462/0 (socket says 172.21.15.57:47462) 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50556a700 1 -- 172.21.15.57:0/77706000 learned_addr learned my addr 172.21.15.57:0/77706000 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50556a700 1 -- 172.21.15.57:0/77706000 >> v2:172.21.15.57:3300/0 conn(0x7fb50010c970 msgr2=0x7fb5000f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50556a700 1 --2- 172.21.15.57:0/77706000 >> v2:172.21.15.57:3300/0 conn(0x7fb50010c970 0x7fb5000f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50556a700 1 -- 172.21.15.57:0/77706000 >> v1:172.21.15.57:6789/0 conn(0x7fb50010cdc0 legacy=0x7fb5000f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50556a700 1 -- 172.21.15.57:0/77706000 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5001aa5e0 con 0x7fb5000f5920 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb4effff700 1 -- 172.21.15.57:0/77706000 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487322355 0 0) 0x7fb4f8001490 con 0x7fb50010cdc0 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb504d69700 1 --2- 172.21.15.57:0/77706000 >> v2:172.21.15.57:3300/0 conn(0x7fb50010c970 0x7fb5000f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50556a700 1 --2- 172.21.15.57:0/77706000 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5000f5920 0x7fb50010c340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb4fc002f70 tx=0x7fb4fc0099d0).ready entity=mon.1 client_cookie=bccb2dd30b3106d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb4effff700 1 -- 172.21.15.57:0/77706000 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5001aa5e0 con 0x7fb5000f5920 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb4effff700 1 -- 172.21.15.57:0/77706000 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc00f510 con 0x7fb5000f5920 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb4effff700 1 -- 172.21.15.57:0/77706000 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4fc00f6f0 con 0x7fb5000f5920 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50876f700 1 -- 172.21.15.57:0/77706000 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5000f5920 msgr2=0x7fb50010c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.721 7fb50876f700 1 --2- 172.21.15.57:0/77706000 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5000f5920 0x7fb50010c340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb4fc002f70 tx=0x7fb4fc0099d0).stop 2024-04-25T02:06:24.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.722 7fb50876f700 1 -- 172.21.15.57:0/77706000 shutdown_connections 2024-04-25T02:06:24.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.722 7fb50876f700 1 --2- 172.21.15.57:0/77706000 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5000f5920 0x7fb50010c340 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.722 7fb50876f700 1 --2- 172.21.15.57:0/77706000 >> v2:172.21.15.57:3300/0 conn(0x7fb50010c970 0x7fb5000f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.722 7fb50876f700 1 -- 172.21.15.57:0/77706000 >> 172.21.15.57:0/77706000 conn(0x7fb500113a70 msgr2=0x7fb5000f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:24.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.722 7fb50876f700 1 -- 172.21.15.57:0/77706000 shutdown_connections 2024-04-25T02:06:24.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.722 7fb50876f700 1 -- 172.21.15.57:0/77706000 wait complete. 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50876f700 1 Processor -- start 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50876f700 1 -- start start 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50876f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5000dd4a0 0x7fb5001ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50876f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5001ab9c0 0x7fb5000d7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50876f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5001abe10 0x7fb5000d7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50876f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5000d86f0 con 0x7fb5001abe10 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50876f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5000d8270 con 0x7fb5001ab9c0 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50876f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5000d84a0 con 0x7fb5000dd4a0 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50556a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5000dd4a0 0x7fb5001ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb504d69700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5001ab9c0 0x7fb5000d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50556a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5000dd4a0 0x7fb5001ab390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50728/0 (socket says 172.21.15.57:50728) 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.746 7fb50556a700 1 -- 172.21.15.57:0/737914174 learned_addr learned my addr 172.21.15.57:0/737914174 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb505d6b700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5001abe10 0x7fb5000d7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb504d69700 1 -- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5000dd4a0 msgr2=0x7fb5001ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb504d69700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5000dd4a0 0x7fb5001ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb504d69700 1 -- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5001abe10 msgr2=0x7fb5000d7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb504d69700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5001abe10 0x7fb5000d7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb504d69700 1 -- 172.21.15.57:0/737914174 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5001b9540 con 0x7fb5001ab9c0 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb50556a700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5000dd4a0 0x7fb5001ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb504d69700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5001ab9c0 0x7fb5000d7610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb5000d8b60 tx=0x7fb4f000eca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb4ee7fc700 1 -- 172.21.15.57:0/737914174 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb5001b9540 con 0x7fb5001ab9c0 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb4ee7fc700 1 -- 172.21.15.57:0/737914174 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f000c730 con 0x7fb5001ab9c0 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb50876f700 1 -- 172.21.15.57:0/737914174 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5001b9740 con 0x7fb5001ab9c0 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb4ee7fc700 1 -- 172.21.15.57:0/737914174 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4f000f040 con 0x7fb5001ab9c0 2024-04-25T02:06:24.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.747 7fb50876f700 1 -- 172.21.15.57:0/737914174 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5001b9b20 con 0x7fb5001ab9c0 2024-04-25T02:06:24.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.748 7fb4ee7fc700 1 -- 172.21.15.57:0/737914174 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb4f0011070 con 0x7fb5001ab9c0 2024-04-25T02:06:24.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.748 7fb4ee7fc700 1 -- 172.21.15.57:0/737914174 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fb4f0010040 con 0x7fb5001ab9c0 2024-04-25T02:06:24.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.748 7fb50876f700 1 -- 172.21.15.57:0/737914174 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5000f08e0 con 0x7fb5001ab9c0 2024-04-25T02:06:24.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.752 7fb4ee7fc700 1 -- 172.21.15.57:0/737914174 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb4f000ede0 con 0x7fb5001ab9c0 2024-04-25T02:06:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.862 7fb50876f700 1 -- 172.21.15.57:0/737914174 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb5000e2430 con 0x7fb5001ab9c0 2024-04-25T02:06:24.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.862 7fb4ee7fc700 1 -- 172.21.15.57:0/737914174 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+11815 (secure 0 0 0) 0x7fb4f002de40 con 0x7fb5001ab9c0 2024-04-25T02:06:24.869 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:24.869 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T02:06:24.869 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 20, 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "f8b8656c-c3d2-4264-b256-59947e4191e7", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-04-25 02:05:27.625638", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-04-25 02:06:23.850624", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2024-04-25 02:05:33.696326", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2024-04-25 02:05:33.696326", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T02:06:24.870 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 4, 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 3, 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 4, 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "nautilus", 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "nautilus", 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25 02:05:37.065200", 2024-04-25T02:06:24.871 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T02:06:24.872 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "12", 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T02:06:24.873 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T02:06:24.874 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T02:06:24.875 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "ddbfde7d-6964-42f8-931b-4c4181565274", 2024-04-25T02:06:24.876 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 9, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 14, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T02:06:24.877 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43631 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2024-04-25T02:06:24.878 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43631 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43631 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43631 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6812/43631", 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6813/43631", 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/43631", 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6814/43631", 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T02:06:24.880 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "76399db5-6fb7-4f04-9c9f-b35ff68a8d56", 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 9, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 14, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T02:06:24.881 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43629 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2024-04-25T02:06:24.882 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43629 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43629 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.883 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43629 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6804/43629", 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6805/43629", 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/43629", 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6806/43629", 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "f0f51faf-c079-4f62-80db-dbec64d28887", 2024-04-25T02:06:24.884 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 9, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 14, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43633 2024-04-25T02:06:24.885 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43633 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.886 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43633 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43633 2024-04-25T02:06:24.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6800/43633", 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6801/43633", 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6803/43633", 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6802/43633", 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2024-04-25T02:06:24.888 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "56f7d9c7-7455-4936-91f1-96bbc0ff7d78", 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 9, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 14, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2024-04-25T02:06:24.889 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43632 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43632 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T02:06:24.890 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43632 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 43632 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.891 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6808/43632", 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6809/43632", 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6811/43632", 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6810/43632", 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2024-04-25T02:06:24.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4611087854035861503, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4611087854035861503, 2024-04-25T02:06:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4611087854035861503, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T02:06:24.894 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4611087854035861503, 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "blacklist": { 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6817/2179885968": "2024-04-26 02:06:20.696237" 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2024-04-25T02:06:24.895 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {} 2024-04-25T02:06:24.896 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T02:06:24.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 -- 172.21.15.57:0/737914174 >> v1:172.21.15.57:6816/43033 conn(0x7fb4e00145b0 legacy=0x7fb4e0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 -- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5001ab9c0 msgr2=0x7fb5000d7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:24.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5001ab9c0 0x7fb5000d7610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb5000d8b60 tx=0x7fb4f000eca0).stop 2024-04-25T02:06:24.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 -- 172.21.15.57:0/737914174 shutdown_connections 2024-04-25T02:06:24.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5001abe10 0x7fb5000d7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5000dd4a0 0x7fb5001ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 --2- 172.21.15.57:0/737914174 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5001ab9c0 0x7fb5000d7610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:24.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 -- 172.21.15.57:0/737914174 >> 172.21.15.57:0/737914174 conn(0x7fb5000c5410 msgr2=0x7fb5000c2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:24.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 -- 172.21.15.57:0/737914174 shutdown_connections 2024-04-25T02:06:24.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:24.864 7fb50876f700 1 -- 172.21.15.57:0/737914174 wait complete. 2024-04-25T02:06:24.899 INFO:tasks.cephfs.cephfs_test_case:Removing 1 blacklist entries 2024-04-25T02:06:24.899 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist rm 172.21.15.57:6817/2179885968 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9fde7700 1 Processor -- start 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9fde7700 1 -- start start 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9fde7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980f5900 0x7fef9810c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9fde7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fef9810c950 0x7fef980f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9fde7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef980f26a0 con 0x7fef9810cda0 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9fde7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef980fa270 con 0x7fef9810c950 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9fde7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef980f95a0 con 0x7fef980f5900 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9cbe2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980f5900 0x7fef9810c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef97fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fef9810c950 0x7fef980f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9cbe2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980f5900 0x7fef9810c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50732/0 (socket says 172.21.15.57:50732) 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9d3e3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fef9810cda0 0x7fef980f1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47466/0 (socket says 172.21.15.57:47466) 2024-04-25T02:06:25.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.026 7fef9cbe2700 1 -- 172.21.15.57:0/836625586 learned_addr learned my addr 172.21.15.57:0/836625586 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef97fff700 1 -- 172.21.15.57:0/836625586 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980f5900 msgr2=0x7fef9810c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef97fff700 1 --2- 172.21.15.57:0/836625586 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980f5900 0x7fef9810c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef97fff700 1 -- 172.21.15.57:0/836625586 >> v1:172.21.15.57:6789/0 conn(0x7fef9810cda0 legacy=0x7fef980f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef97fff700 1 -- 172.21.15.57:0/836625586 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef981aa5c0 con 0x7fef9810c950 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef977fe700 1 -- 172.21.15.57:0/836625586 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569632824 0 0) 0x7fef90001490 con 0x7fef9810cda0 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef9cbe2700 1 --2- 172.21.15.57:0/836625586 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980f5900 0x7fef9810c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef97fff700 1 --2- 172.21.15.57:0/836625586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef9810c950 0x7fef980f1870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fef981133e0 tx=0x7fef8000ba20).ready entity=mon.0 client_cookie=597d669c09c2df7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef977fe700 1 -- 172.21.15.57:0/836625586 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef981aa5c0 con 0x7fef9810c950 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef977fe700 1 -- 172.21.15.57:0/836625586 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8000d5c0 con 0x7fef9810c950 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef977fe700 1 -- 172.21.15.57:0/836625586 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef8000d990 con 0x7fef9810c950 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef9fde7700 1 -- 172.21.15.57:0/836625586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef9810c950 msgr2=0x7fef980f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef9fde7700 1 --2- 172.21.15.57:0/836625586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef9810c950 0x7fef980f1870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fef981133e0 tx=0x7fef8000ba20).stop 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.027 7fef9fde7700 1 -- 172.21.15.57:0/836625586 shutdown_connections 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.028 7fef9fde7700 1 --2- 172.21.15.57:0/836625586 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980f5900 0x7fef9810c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:25.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.028 7fef9fde7700 1 --2- 172.21.15.57:0/836625586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef9810c950 0x7fef980f1870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:25.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.028 7fef9fde7700 1 -- 172.21.15.57:0/836625586 >> 172.21.15.57:0/836625586 conn(0x7fef98113a50 msgr2=0x7fef980f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:25.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.028 7fef9fde7700 1 -- 172.21.15.57:0/836625586 shutdown_connections 2024-04-25T02:06:25.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.028 7fef9fde7700 1 -- 172.21.15.57:0/836625586 wait complete. 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.051 7fef9fde7700 1 Processor -- start 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.051 7fef9fde7700 1 -- start start 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9fde7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980ce320 0x7fef980d6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9fde7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef980d6760 0x7fef981b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9fde7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef980d6bb0 0x7fef981b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9fde7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef980cd5e0 con 0x7fef980d6bb0 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9fde7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef981b2c80 con 0x7fef980d6760 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9fde7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef981b2eb0 con 0x7fef980ce320 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9cbe2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980ce320 0x7fef980d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:25.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9d3e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef980d6bb0 0x7fef981b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef97fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef980d6760 0x7fef981b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9cbe2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980ce320 0x7fef980d6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50746/0 (socket says 172.21.15.57:50746) 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9cbe2700 1 -- 172.21.15.57:0/4053727508 learned_addr learned my addr 172.21.15.57:0/4053727508 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9d3e3700 1 -- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980ce320 msgr2=0x7fef980d6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9d3e3700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980ce320 0x7fef980d6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9d3e3700 1 -- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef980d6760 msgr2=0x7fef981b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9d3e3700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef980d6760 0x7fef981b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9d3e3700 1 -- 172.21.15.57:0/4053727508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef981b9790 con 0x7fef980d6bb0 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef9cbe2700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980ce320 0x7fef980d6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.052 7fef97fff700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef980d6760 0x7fef981b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.053 7fef9d3e3700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef980d6bb0 0x7fef981b2650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fef90000f40 tx=0x7fef9000c930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.053 7fef95ffb700 1 -- 172.21.15.57:0/4053727508 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef981b9790 con 0x7fef980d6bb0 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.053 7fef95ffb700 1 -- 172.21.15.57:0/4053727508 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef90005af0 con 0x7fef980d6bb0 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.053 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef980f6370 con 0x7fef980d6bb0 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.053 7fef95ffb700 1 -- 172.21.15.57:0/4053727508 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef900070d0 con 0x7fef980d6bb0 2024-04-25T02:06:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.053 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef980f66e0 con 0x7fef980d6bb0 2024-04-25T02:06:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.053 7fef95ffb700 1 -- 172.21.15.57:0/4053727508 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fef900072d0 con 0x7fef980d6bb0 2024-04-25T02:06:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.053 7fef95ffb700 1 -- 172.21.15.57:0/4053727508 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fef90014a10 con 0x7fef980d6bb0 2024-04-25T02:06:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.054 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef980f08c0 con 0x7fef980d6bb0 2024-04-25T02:06:25.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.057 7fef95ffb700 1 -- 172.21.15.57:0/4053727508 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fef900058e0 con 0x7fef980d6bb0 2024-04-25T02:06:25.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.182 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.57:6817/2179885968"} v 0) v1 -- 0x7fef981ac720 con 0x7fef980d6bb0 2024-04-25T02:06:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.924 7fef95ffb700 1 -- 172.21.15.57:0/4053727508 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist", "blacklistop": "rm", "addr": "172.21.15.57:6817/2179885968"}]=0 un-blacklisting 172.21.15.57:6817/2179885968 v21) v1 ==== 166+0+0 (secure 0 0 0) 0x7fef981145d0 con 0x7fef980d6bb0 2024-04-25T02:06:25.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 >> v1:172.21.15.57:6816/43033 conn(0x7fef7c014540 legacy=0x7fef7c016a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef980d6bb0 msgr2=0x7fef981b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef980d6bb0 0x7fef981b2650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fef90000f40 tx=0x7fef9000c930).stop 2024-04-25T02:06:25.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 shutdown_connections 2024-04-25T02:06:25.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef980d6bb0 0x7fef981b2650 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:25.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef980ce320 0x7fef980d6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:25.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 --2- 172.21.15.57:0/4053727508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef980d6760 0x7fef981b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:25.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 >> 172.21.15.57:0/4053727508 conn(0x7fef980c3a50 msgr2=0x7fef980dafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:25.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 shutdown_connections 2024-04-25T02:06:25.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:25.926 7fef9fde7700 1 -- 172.21.15.57:0/4053727508 wait complete. 2024-04-25T02:06:25.936 INFO:teuthology.orchestra.run.smithi057.stderr:un-blacklisting 172.21.15.57:6817/2179885968 2024-04-25T02:06:25.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T02:06:26.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.079 7f370073e700 1 Processor -- start 2024-04-25T02:06:26.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.079 7f370073e700 1 -- start start 2024-04-25T02:06:26.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.079 7f370073e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36f80f5a10 0x7f36f810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.079 7f370073e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f810b740 0x7f36f819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f370073e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f810bb90 0x7f36f81a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f370073e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80fa590 con 0x7f36f80f5a10 2024-04-25T02:06:26.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f370073e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f81a08a0 con 0x7f36f810b740 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f370073e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f81a0ad0 con 0x7f36f810bb90 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36f80f5a10 0x7f36f810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fdd3a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f810bb90 0x7f36f81a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36f80f5a10 0x7f36f810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51278/0 (socket says 172.21.15.57:51278) 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 -- 172.21.15.57:0/3491484648 learned_addr learned my addr 172.21.15.57:0/3491484648 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fcd38700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f810b740 0x7f36f819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 -- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f810bb90 msgr2=0x7f36f81a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f810bb90 0x7f36f81a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 -- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f810b740 msgr2=0x7f36f819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f810b740 0x7f36f819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 -- 172.21.15.57:0/3491484648 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f81a73b0 con 0x7f36f80f5a10 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fcd38700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f810b740 0x7f36f819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:26.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fdd3a700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f810bb90 0x7f36f81a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36fd539700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f80f5a10 0x7f36f810b110 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f36f4002f70 tx=0x7f36f4009a50).ready entity=mon.0 client_cookie=b7d98ddaf87cdc14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36e7fff700 1 -- 172.21.15.57:0/3491484648 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36f81a73b0 con 0x7f36f80f5a10 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36e7fff700 1 -- 172.21.15.57:0/3491484648 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400f510 con 0x7f36f80f5a10 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f36e7fff700 1 -- 172.21.15.57:0/3491484648 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36f400f6f0 con 0x7f36f80f5a10 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f370073e700 1 -- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f80f5a10 msgr2=0x7f36f810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.080 7f370073e700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f80f5a10 0x7f36f810b110 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f36f4002f70 tx=0x7f36f4009a50).stop 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.081 7f370073e700 1 -- 172.21.15.57:0/3491484648 shutdown_connections 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.081 7f370073e700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f810bb90 0x7f36f81a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.081 7f370073e700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f80f5a10 0x7f36f810b110 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.081 7f370073e700 1 --2- 172.21.15.57:0/3491484648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f810b740 0x7f36f819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.081 7f370073e700 1 -- 172.21.15.57:0/3491484648 >> 172.21.15.57:0/3491484648 conn(0x7f36f8113a70 msgr2=0x7f36f80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.081 7f370073e700 1 -- 172.21.15.57:0/3491484648 shutdown_connections 2024-04-25T02:06:26.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.081 7f370073e700 1 -- 172.21.15.57:0/3491484648 wait complete. 2024-04-25T02:06:26.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f370073e700 1 Processor -- start 2024-04-25T02:06:26.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f370073e700 1 -- start start 2024-04-25T02:06:26.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f370073e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f81ad950 0x7f36f81adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f370073e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f81ae3d0 0x7f36f81b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f370073e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f81b4940 0x7f36f81b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f370073e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80f1df0 con 0x7f36f81ae3d0 2024-04-25T02:06:26.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f370073e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f81b53c0 con 0x7f36f81ad950 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f370073e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80f1b30 con 0x7f36f81b4940 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f36fd539700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f81ad950 0x7f36f81adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f36fdd3a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f81b4940 0x7f36f81b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f36fd539700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f81ad950 0x7f36f81adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50078/0 (socket says 172.21.15.57:50078) 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f36fd539700 1 -- 172.21.15.57:0/838488269 learned_addr learned my addr 172.21.15.57:0/838488269 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.105 7f36fcd38700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f81ae3d0 0x7f36f81b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36fd539700 1 -- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f81b4940 msgr2=0x7f36f81b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36fd539700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f81b4940 0x7f36f81b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36fd539700 1 -- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f81ae3d0 msgr2=0x7f36f81b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36fd539700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f81ae3d0 0x7f36f81b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36fd539700 1 -- 172.21.15.57:0/838488269 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80e0020 con 0x7f36f81ad950 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36fdd3a700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f81b4940 0x7f36f81b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36fcd38700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f81ae3d0 0x7f36f81b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36fd539700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f81ad950 0x7f36f81adda0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f36f80c4aa0 tx=0x7f36f40068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:26.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36e67fc700 1 -- 172.21.15.57:0/838488269 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36f80e0020 con 0x7f36f81ad950 2024-04-25T02:06:26.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36e67fc700 1 -- 172.21.15.57:0/838488269 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f4011610 con 0x7f36f81ad950 2024-04-25T02:06:26.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f370073e700 1 -- 172.21.15.57:0/838488269 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f80c4750 con 0x7f36f81ad950 2024-04-25T02:06:26.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f36e67fc700 1 -- 172.21.15.57:0/838488269 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36f40119e0 con 0x7f36f81ad950 2024-04-25T02:06:26.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.106 7f370073e700 1 -- 172.21.15.57:0/838488269 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f81bbc60 con 0x7f36f81ad950 2024-04-25T02:06:26.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.107 7f36e67fc700 1 -- 172.21.15.57:0/838488269 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f36f4011be0 con 0x7f36f81ad950 2024-04-25T02:06:26.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.107 7f36e67fc700 1 -- 172.21.15.57:0/838488269 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f36f4020ba0 con 0x7f36f81ad950 2024-04-25T02:06:26.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.107 7f370073e700 1 -- 172.21.15.57:0/838488269 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f80f08e0 con 0x7f36f81ad950 2024-04-25T02:06:26.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.110 7f36e67fc700 1 -- 172.21.15.57:0/838488269 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f36f400f300 con 0x7f36f81ad950 2024-04-25T02:06:26.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.257 7f370073e700 1 -- 172.21.15.57:0/838488269 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f36f80e2430 con 0x7f36f81ad950 2024-04-25T02:06:26.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.258 7f36e67fc700 1 -- 172.21.15.57:0/838488269 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+3573 (secure 0 0 0) 0x7f36f4011400 con 0x7f36f81ad950 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBSuilmO1oWLxAArysde978mbarOwZSPMywzA==", 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2024-04-25T02:06:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBZuilmweqSGhAALXUj2D/6AlBLKdcUuXNzKA==", 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2024-04-25T02:06:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBcuilmbisWHBAAHiuivOC04I0il/7Hm9/uCQ==", 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBfuilmmFXvGhAAqldpMS3iYyQcUQ+W7AUYxQ==", 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBiuilmZV9aGhAAZYzZBXdw9fI3SY5KyjF5qQ==", 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBTuilmEbwpChAAcGmewNlQSRRToPdVh/V8cQ==", 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBSuilmlj5UDhAA3d1uqO0Qeai0poq+PFDM6g==", 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-04-25T02:06:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mds", 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBnuilmBE5PJRAALMlg9boXcCj5a1NvWP+vqw==", 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBnuilmjVdPJRAA9ZM0YC0C4xyEDVsSwSbuYw==", 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T02:06:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-osd", 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBnuilmBWFPJRAARVNaEsAdJTZxl3JpL5h96A==", 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBnuilmj2lPJRAAFzTMI1oxbaXzPjCCAeJhxQ==", 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T02:06:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBnuilmRXJPJRAAgsB0999VgxRLt9l26L/+Jg==", 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBnuilm8HpPJRAAkmjlvzwMjabmhN6/OLNSyw==", 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBSuilmNntsKhAAELQvuVTpgBXHLgssPC1P/g==", 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T02:06:26.273 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T02:06:26.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 -- 172.21.15.57:0/838488269 >> v1:172.21.15.57:6816/43033 conn(0x7f36d80145b0 legacy=0x7f36d8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 -- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f81ad950 msgr2=0x7f36f81adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f81ad950 0x7f36f81adda0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f36f80c4aa0 tx=0x7f36f40068c0).stop 2024-04-25T02:06:26.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 -- 172.21.15.57:0/838488269 shutdown_connections 2024-04-25T02:06:26.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f36f81b4940 0x7f36f81b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36f81ad950 0x7f36f81adda0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 --2- 172.21.15.57:0/838488269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36f81ae3d0 0x7f36f81b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 -- 172.21.15.57:0/838488269 >> 172.21.15.57:0/838488269 conn(0x7f36f80c92e0 msgr2=0x7f36f80d72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:26.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 -- 172.21.15.57:0/838488269 shutdown_connections 2024-04-25T02:06:26.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.259 7f370073e700 1 -- 172.21.15.57:0/838488269 wait complete. 2024-04-25T02:06:26.277 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T02:06:26.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.403 7f60959e2700 1 Processor -- start 2024-04-25T02:06:26.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.403 7f60959e2700 1 -- start start 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.403 7f60959e2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f609010b900 0x7f60901a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.403 7f60959e2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901a59c0 0x7f60901a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.403 7f60959e2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609010bd50 con 0x7f60900f5a00 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.403 7f60959e2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900fa580 con 0x7f609010b900 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.403 7f60959e2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60901a0c40 con 0x7f60901a59c0 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608e7d8700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f60900f5a00 0x7f609010b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55592/0 (socket says 172.21.15.57:55592) 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608e7d8700 1 -- 172.21.15.57:0/2202710188 learned_addr learned my addr 172.21.15.57:0/2202710188 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608efd9700 1 --2- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901a59c0 0x7f60901a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f6085fd7700 1 --2- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f609010b900 0x7f60901a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608dfd7700 1 -- 172.21.15.57:0/2202710188 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603052639 0 0) 0x7f6080001110 con 0x7f60900f5a00 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608efd9700 1 -- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f609010b900 msgr2=0x7f60901a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608efd9700 1 --2- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f609010b900 0x7f60901a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608efd9700 1 -- 172.21.15.57:0/2202710188 >> v1:172.21.15.57:6789/0 conn(0x7f60900f5a00 legacy=0x7f609010b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608efd9700 1 -- 172.21.15.57:0/2202710188 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60901a9460 con 0x7f60901a59c0 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f6085fd7700 1 --2- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f609010b900 0x7f60901a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608efd9700 1 --2- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901a59c0 0x7f60901a7e20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f60900f47b0 tx=0x7f6088009cf0).ready entity=mon.2 client_cookie=ecccd28a42f53eec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608dfd7700 1 -- 172.21.15.57:0/2202710188 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60901a9460 con 0x7f60901a59c0 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608dfd7700 1 -- 172.21.15.57:0/2202710188 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608800b840 con 0x7f60901a59c0 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f608dfd7700 1 -- 172.21.15.57:0/2202710188 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f608800ba20 con 0x7f60901a59c0 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f60959e2700 1 -- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901a59c0 msgr2=0x7f60901a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.404 7f60959e2700 1 --2- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901a59c0 0x7f60901a7e20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f60900f47b0 tx=0x7f6088009cf0).stop 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.405 7f60959e2700 1 -- 172.21.15.57:0/2202710188 shutdown_connections 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.405 7f60959e2700 1 --2- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901a59c0 0x7f60901a7e20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.405 7f60959e2700 1 --2- 172.21.15.57:0/2202710188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f609010b900 0x7f60901a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.405 7f60959e2700 1 -- 172.21.15.57:0/2202710188 >> 172.21.15.57:0/2202710188 conn(0x7f6090113a60 msgr2=0x7f60900f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:26.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.405 7f60959e2700 1 -- 172.21.15.57:0/2202710188 shutdown_connections 2024-04-25T02:06:26.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.405 7f60959e2700 1 -- 172.21.15.57:0/2202710188 wait complete. 2024-04-25T02:06:26.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f60959e2700 1 Processor -- start 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f60959e2700 1 -- start start 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f60959e2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60901b28e0 0x7f60901b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f60959e2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901b3360 0x7f60900c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f60959e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60900c2ca0 0x7f60901b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f60959e2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60900a83c0 con 0x7f60900c2ca0 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f60959e2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900d7250 con 0x7f60901b28e0 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f60959e2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60900bf140 con 0x7f60901b3360 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f608e7d8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60901b28e0 0x7f60901b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f608efd9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60900c2ca0 0x7f60901b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f608e7d8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60901b28e0 0x7f60901b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60634/0 (socket says 172.21.15.57:60634) 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f608e7d8700 1 -- 172.21.15.57:0/2231678434 learned_addr learned my addr 172.21.15.57:0/2231678434 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.429 7f6085fd7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901b3360 0x7f60900c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f608e7d8700 1 -- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901b3360 msgr2=0x7f60900c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f608e7d8700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901b3360 0x7f60900c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f608e7d8700 1 -- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60900c2ca0 msgr2=0x7f60901b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f608e7d8700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60900c2ca0 0x7f60901b9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f608e7d8700 1 -- 172.21.15.57:0/2231678434 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900bfd90 con 0x7f60901b28e0 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f608efd9700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60900c2ca0 0x7f60901b9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f6085fd7700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901b3360 0x7f60900c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f608e7d8700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60901b28e0 0x7f60901b2d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f60900e1400 tx=0x7f608000c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f6087fff700 1 -- 172.21.15.57:0/2231678434 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f60900bfd90 con 0x7f60901b28e0 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f6087fff700 1 -- 172.21.15.57:0/2231678434 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60800072e0 con 0x7f60901b28e0 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f6087fff700 1 -- 172.21.15.57:0/2231678434 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6080005810 con 0x7f60901b28e0 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f60959e2700 1 -- 172.21.15.57:0/2231678434 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60900ce080 con 0x7f60901b28e0 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f60959e2700 1 -- 172.21.15.57:0/2231678434 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60900c30f0 con 0x7f60901b28e0 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.430 7f6087fff700 1 -- 172.21.15.57:0/2231678434 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6080005a10 con 0x7f60901b28e0 2024-04-25T02:06:26.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.431 7f6087fff700 1 -- 172.21.15.57:0/2231678434 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f60800146b0 con 0x7f60901b28e0 2024-04-25T02:06:26.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.431 7f60959e2700 1 -- 172.21.15.57:0/2231678434 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60900f08d0 con 0x7f60901b28e0 2024-04-25T02:06:26.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.435 7f6087fff700 1 -- 172.21.15.57:0/2231678434 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f60800070d0 con 0x7f60901b28e0 2024-04-25T02:06:26.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.582 7f60959e2700 1 -- 172.21.15.57:0/2231678434 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f60900ab8d0 con 0x7f60901b28e0 2024-04-25T02:06:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.591 7f6087fff700 1 -- 172.21.15.57:0/2231678434 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v3) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6080000c30 con 0x7f60901b28e0 2024-04-25T02:06:26.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 -- 172.21.15.57:0/2231678434 >> v1:172.21.15.57:6816/43033 conn(0x7f60740145b0 legacy=0x7f6074016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 -- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60901b28e0 msgr2=0x7f60901b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60901b28e0 0x7f60901b2d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f60900e1400 tx=0x7f608000c860).stop 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 -- 172.21.15.57:0/2231678434 shutdown_connections 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60900c2ca0 0x7f60901b9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60901b28e0 0x7f60901b2d30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 --2- 172.21.15.57:0/2231678434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f60901b3360 0x7f60900c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 -- 172.21.15.57:0/2231678434 >> 172.21.15.57:0/2231678434 conn(0x7f60900c5c10 msgr2=0x7f60900c0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 -- 172.21.15.57:0/2231678434 shutdown_connections 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.592 7f60959e2700 1 -- 172.21.15.57:0/2231678434 wait complete. 2024-04-25T02:06:26.600 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2024-04-25T02:06:26.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.735 7f889e0ea700 1 Processor -- start 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f889e0ea700 1 -- start start 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f889e0ea700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88980f5980 0x7f889810b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f889e0ea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f889810b6b0 0x7f889819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f889e0ea700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88981a09e0 con 0x7f889810bb00 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f889e0ea700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88980fa500 con 0x7f88980f5980 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f889e0ea700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88981a0c00 con 0x7f889810b6b0 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f888e5c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f889810b6b0 0x7f889819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f888e5c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f889810b6b0 0x7f889819fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60642/0 (socket says 172.21.15.57:60642) 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f88975c7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f889810bb00 0x7f88981a01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55594/0 (socket says 172.21.15.57:55594) 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f8896dc6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88980f5980 0x7f889810b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.736 7f888e5c5700 1 -- 172.21.15.57:0/1801099642 learned_addr learned my addr 172.21.15.57:0/1801099642 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f8896dc6700 1 -- 172.21.15.57:0/1801099642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f889810b6b0 msgr2=0x7f889819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f8896dc6700 1 --2- 172.21.15.57:0/1801099642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f889810b6b0 0x7f889819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f8896dc6700 1 -- 172.21.15.57:0/1801099642 >> v1:172.21.15.57:6789/0 conn(0x7f889810bb00 legacy=0x7f88981a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f8896dc6700 1 -- 172.21.15.57:0/1801099642 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88981a9340 con 0x7f88980f5980 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f88965c5700 1 -- 172.21.15.57:0/1801099642 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660256960 0 0) 0x7f8890001490 con 0x7f889810bb00 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f888e5c5700 1 --2- 172.21.15.57:0/1801099642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f889810b6b0 0x7f889819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f8896dc6700 1 --2- 172.21.15.57:0/1801099642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980f5980 0x7f889810b080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f889810f890 tx=0x7f888800ba20).ready entity=mon.0 client_cookie=e26a4fffd9ae98bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f88965c5700 1 -- 172.21.15.57:0/1801099642 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88981a9340 con 0x7f88980f5980 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f88965c5700 1 -- 172.21.15.57:0/1801099642 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888800d5c0 con 0x7f88980f5980 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f88965c5700 1 -- 172.21.15.57:0/1801099642 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f888800d990 con 0x7f88980f5980 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f889e0ea700 1 -- 172.21.15.57:0/1801099642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980f5980 msgr2=0x7f889810b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f889e0ea700 1 --2- 172.21.15.57:0/1801099642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980f5980 0x7f889810b080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f889810f890 tx=0x7f888800ba20).stop 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f889e0ea700 1 -- 172.21.15.57:0/1801099642 shutdown_connections 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f889e0ea700 1 --2- 172.21.15.57:0/1801099642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980f5980 0x7f889810b080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f889e0ea700 1 --2- 172.21.15.57:0/1801099642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f889810b6b0 0x7f889819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.737 7f889e0ea700 1 -- 172.21.15.57:0/1801099642 >> 172.21.15.57:0/1801099642 conn(0x7f88981139e0 msgr2=0x7f88980f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.738 7f889e0ea700 1 -- 172.21.15.57:0/1801099642 shutdown_connections 2024-04-25T02:06:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.738 7f889e0ea700 1 -- 172.21.15.57:0/1801099642 wait complete. 2024-04-25T02:06:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.761 7f889e0ea700 1 Processor -- start 2024-04-25T02:06:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f889e0ea700 1 -- start start 2024-04-25T02:06:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f889e0ea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88980d6de0 0x7f88980ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f889e0ea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88980ced90 0x7f88981b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f889e0ea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980cf1e0 0x7f88981b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f889e0ea700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980e09c0 con 0x7f88980cf1e0 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f889e0ea700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980bb370 con 0x7f88980ced90 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f889e0ea700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88981b4f90 con 0x7f88980d6de0 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f88975c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980cf1e0 0x7f88981b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f8896dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88980d6de0 0x7f88980ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f888e5c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88980ced90 0x7f88981b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f8896dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88980d6de0 0x7f88980ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48226/0 (socket says 172.21.15.57:48226) 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f88975c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980cf1e0 0x7f88981b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56792/0 (socket says 172.21.15.57:56792) 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f8896dc6700 1 -- 172.21.15.57:0/68618629 learned_addr learned my addr 172.21.15.57:0/68618629 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f888e5c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88980ced90 0x7f88981b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60644/0 (socket says 172.21.15.57:60644) 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f888e5c5700 1 -- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88980d6de0 msgr2=0x7f88980ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f888e5c5700 1 --2- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88980d6de0 0x7f88980ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f888e5c5700 1 -- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980cf1e0 msgr2=0x7f88981b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f888e5c5700 1 --2- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980cf1e0 0x7f88981b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f888e5c5700 1 -- 172.21.15.57:0/68618629 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88981b5170 con 0x7f88980ced90 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.762 7f888e5c5700 1 --2- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88980ced90 0x7f88981b4330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f88980e1250 tx=0x7f888000ead0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.763 7f8894dc2700 1 -- 172.21.15.57:0/68618629 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88981b5170 con 0x7f88980ced90 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.763 7f8894dc2700 1 -- 172.21.15.57:0/68618629 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8880012600 con 0x7f88980ced90 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.763 7f8894dc2700 1 -- 172.21.15.57:0/68618629 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f888000f040 con 0x7f88980ced90 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.763 7f889e0ea700 1 -- 172.21.15.57:0/68618629 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88981bba20 con 0x7f88980ced90 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.763 7f889e0ea700 1 -- 172.21.15.57:0/68618629 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88981bbe00 con 0x7f88980ced90 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.763 7f8894dc2700 1 -- 172.21.15.57:0/68618629 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f8880022060 con 0x7f88980ced90 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.763 7f8894dc2700 1 -- 172.21.15.57:0/68618629 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f8880010040 con 0x7f88980ced90 2024-04-25T02:06:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.764 7f889e0ea700 1 -- 172.21.15.57:0/68618629 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88980f0850 con 0x7f88980ced90 2024-04-25T02:06:26.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.767 7f8894dc2700 1 -- 172.21.15.57:0/68618629 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f88800123f0 con 0x7f88980ced90 2024-04-25T02:06:26.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.910 7f889e0ea700 1 -- 172.21.15.57:0/68618629 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f88980e2430 con 0x7f88980ced90 2024-04-25T02:06:26.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.923 7f8894dc2700 1 -- 172.21.15.57:0/68618629 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v4) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8880000c30 con 0x7f88980ced90 2024-04-25T02:06:26.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 -- 172.21.15.57:0/68618629 >> v1:172.21.15.57:6816/43033 conn(0x7f887c0145b0 legacy=0x7f887c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 -- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88980ced90 msgr2=0x7f88981b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:26.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 --2- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88980ced90 0x7f88981b4330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f88980e1250 tx=0x7f888000ead0).stop 2024-04-25T02:06:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 -- 172.21.15.57:0/68618629 shutdown_connections 2024-04-25T02:06:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 --2- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88980cf1e0 0x7f88981b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 --2- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88980d6de0 0x7f88980ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 --2- 172.21.15.57:0/68618629 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88980ced90 0x7f88981b4330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 -- 172.21.15.57:0/68618629 >> 172.21.15.57:0/68618629 conn(0x7f88980c5ac0 msgr2=0x7f88980d7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 -- 172.21.15.57:0/68618629 shutdown_connections 2024-04-25T02:06:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:26.924 7f889e0ea700 1 -- 172.21.15.57:0/68618629 wait complete. 2024-04-25T02:06:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2024-04-25T02:06:26.943 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T02:06:27.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.068 7f7125114700 1 Processor -- start 2024-04-25T02:06:27.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.068 7f7125114700 1 -- start start 2024-04-25T02:06:27.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f7125114700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71200f5890 0x7f71200f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f7125114700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71200f1e30 0x7f712010e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f7125114700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71200f2280 0x7f712010e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f7125114700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71200f91a0 con 0x7f71200f1e30 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f7125114700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712010ee80 con 0x7f71200f2280 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f7125114700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71201aa5d0 con 0x7f71200f5890 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71200f1e30 0x7f712010e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f711ddfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71200f5890 0x7f71200f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f711e5fd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71200f2280 0x7f712010e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71200f1e30 0x7f712010e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56796/0 (socket says 172.21.15.57:56796) 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 -- 172.21.15.57:0/826996818 learned_addr learned my addr 172.21.15.57:0/826996818 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f711e5fd700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71200f2280 0x7f712010e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60654/0 (socket says 172.21.15.57:60654) 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 -- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71200f5890 msgr2=0x7f71200f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71200f5890 0x7f71200f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 -- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71200f2280 msgr2=0x7f712010e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71200f2280 0x7f712010e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 -- 172.21.15.57:0/826996818 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71201aa780 con 0x7f71200f1e30 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f711ddfc700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71200f5890 0x7f71200f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f711e5fd700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71200f2280 0x7f712010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.069 7f71155fb700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200f1e30 0x7f712010e220 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f7120103760 tx=0x7f7108009a80).ready entity=mon.0 client_cookie=6a139ab8b1d8d7e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f711d5fb700 1 -- 172.21.15.57:0/826996818 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71201aa780 con 0x7f71200f1e30 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f711d5fb700 1 -- 172.21.15.57:0/826996818 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710800f510 con 0x7f71200f1e30 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f711d5fb700 1 -- 172.21.15.57:0/826996818 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f710800f6f0 con 0x7f71200f1e30 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 -- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200f1e30 msgr2=0x7f712010e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200f1e30 0x7f712010e220 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f7120103760 tx=0x7f7108009a80).stop 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 -- 172.21.15.57:0/826996818 shutdown_connections 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71200f2280 0x7f712010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71200f5890 0x7f71200f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 --2- 172.21.15.57:0/826996818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200f1e30 0x7f712010e220 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 -- 172.21.15.57:0/826996818 >> 172.21.15.57:0/826996818 conn(0x7f71201139e0 msgr2=0x7f71200f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 -- 172.21.15.57:0/826996818 shutdown_connections 2024-04-25T02:06:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.070 7f7125114700 1 -- 172.21.15.57:0/826996818 wait complete. 2024-04-25T02:06:27.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.094 7f7125114700 1 Processor -- start 2024-04-25T02:06:27.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.094 7f7125114700 1 -- start start 2024-04-25T02:06:27.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f7125114700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71201b17f0 0x7f71201b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f7125114700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71201b2270 0x7f71200bd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f7125114700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200bd980 0x7f71200bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f7125114700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200be880 con 0x7f71200bd980 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f7125114700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71200daf10 con 0x7f71201b2270 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f7125114700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71200c9f70 con 0x7f71201b17f0 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711ddfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71201b17f0 0x7f71201b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200bd980 0x7f71200bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200bd980 0x7f71200bddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56798/0 (socket says 172.21.15.57:56798) 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711ddfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71201b17f0 0x7f71201b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48240/0 (socket says 172.21.15.57:48240) 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 -- 172.21.15.57:0/1885299692 learned_addr learned my addr 172.21.15.57:0/1885299692 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f71155fb700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71201b2270 0x7f71200bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 -- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71201b17f0 msgr2=0x7f71201b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71201b17f0 0x7f71201b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 -- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71201b2270 msgr2=0x7f71200bd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71201b2270 0x7f71200bd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 -- 172.21.15.57:0/1885299692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71200db3d0 con 0x7f71200bd980 2024-04-25T02:06:27.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711ddfc700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71201b17f0 0x7f71201b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.095 7f711e5fd700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200bd980 0x7f71200bddd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f71200c4630 tx=0x7f711800ee60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.096 7f71177fe700 1 -- 172.21.15.57:0/1885299692 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71200db3d0 con 0x7f71200bd980 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.096 7f71177fe700 1 -- 172.21.15.57:0/1885299692 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711800c880 con 0x7f71200bd980 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.096 7f7125114700 1 -- 172.21.15.57:0/1885299692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71200db110 con 0x7f71200bd980 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.096 7f71177fe700 1 -- 172.21.15.57:0/1885299692 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f711800f040 con 0x7f71200bd980 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.096 7f7125114700 1 -- 172.21.15.57:0/1885299692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71201bc320 con 0x7f71200bd980 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.096 7f71177fe700 1 -- 172.21.15.57:0/1885299692 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7118022060 con 0x7f71200bd980 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.096 7f71177fe700 1 -- 172.21.15.57:0/1885299692 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f7118010040 con 0x7f71200bd980 2024-04-25T02:06:27.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.097 7f7125114700 1 -- 172.21.15.57:0/1885299692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71200f0850 con 0x7f71200bd980 2024-04-25T02:06:27.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.100 7f71177fe700 1 -- 172.21.15.57:0/1885299692 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f711800c670 con 0x7f71200bd980 2024-04-25T02:06:27.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.244 7f7125114700 1 -- 172.21.15.57:0/1885299692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f71200c9c70 con 0x7f71200bd980 2024-04-25T02:06:27.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.251 7f71177fe700 1 -- 172.21.15.57:0/1885299692 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7120114560 con 0x7f71200bd980 2024-04-25T02:06:27.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 -- 172.21.15.57:0/1885299692 >> v1:172.21.15.57:6816/43033 conn(0x7f71040145b0 legacy=0x7f7104016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 -- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200bd980 msgr2=0x7f71200bddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200bd980 0x7f71200bddd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f71200c4630 tx=0x7f711800ee60).stop 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 -- 172.21.15.57:0/1885299692 shutdown_connections 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71200bd980 0x7f71200bddd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f71201b17f0 0x7f71201b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 --2- 172.21.15.57:0/1885299692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71201b2270 0x7f71200bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 -- 172.21.15.57:0/1885299692 >> 172.21.15.57:0/1885299692 conn(0x7f71200de950 msgr2=0x7f71200d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 -- 172.21.15.57:0/1885299692 shutdown_connections 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.252 7f7125114700 1 -- 172.21.15.57:0/1885299692 wait complete. 2024-04-25T02:06:27.260 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2024-04-25T02:06:27.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T02:06:27.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.396 7f6df01a6700 1 Processor -- start 2024-04-25T02:06:27.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.396 7f6df01a6700 1 -- start start 2024-04-25T02:06:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6df01a6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80f5890 0x7f6de810c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6df01a6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de810cd30 0x7f6de80f2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6df01a6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de80f2630 con 0x7f6de810c8e0 2024-04-25T02:06:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6df01a6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80fa200 con 0x7f6de810cd30 2024-04-25T02:06:27.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6df01a6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80f9530 con 0x7f6de80f5890 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6decfa1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80f5890 0x7f6de810c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6ded7a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de810cd30 0x7f6de80f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6decfa1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80f5890 0x7f6de810c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48256/0 (socket says 172.21.15.57:48256) 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6decfa1700 1 -- 172.21.15.57:0/2559050583 learned_addr learned my addr 172.21.15.57:0/2559050583 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6de7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6de810c8e0 0x7f6de80f1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55608/0 (socket says 172.21.15.57:55608) 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6ded7a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de810cd30 0x7f6de80f2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60684/0 (socket says 172.21.15.57:60684) 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6ded7a2700 1 -- 172.21.15.57:0/2559050583 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80f5890 msgr2=0x7f6de810c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6ded7a2700 1 --2- 172.21.15.57:0/2559050583 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80f5890 0x7f6de810c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6ded7a2700 1 -- 172.21.15.57:0/2559050583 >> v1:172.21.15.57:6789/0 conn(0x7f6de810c8e0 legacy=0x7f6de80f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6de77fe700 1 -- 172.21.15.57:0/2559050583 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321494604 0 0) 0x7f6dd4001110 con 0x7f6de810c8e0 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6ded7a2700 1 -- 172.21.15.57:0/2559050583 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de81aa550 con 0x7f6de810cd30 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6decfa1700 1 --2- 172.21.15.57:0/2559050583 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80f5890 0x7f6de810c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6ded7a2700 1 --2- 172.21.15.57:0/2559050583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de810cd30 0x7f6de80f2000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6de80f62c0 tx=0x7f6de0009d70).ready entity=mon.1 client_cookie=aa97a10ae73fea5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6de77fe700 1 -- 172.21.15.57:0/2559050583 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6de81aa550 con 0x7f6de810cd30 2024-04-25T02:06:27.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6de77fe700 1 -- 172.21.15.57:0/2559050583 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de000b7c0 con 0x7f6de810cd30 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6de77fe700 1 -- 172.21.15.57:0/2559050583 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6de000b9a0 con 0x7f6de810cd30 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6df01a6700 1 -- 172.21.15.57:0/2559050583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de810cd30 msgr2=0x7f6de80f2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.397 7f6df01a6700 1 --2- 172.21.15.57:0/2559050583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de810cd30 0x7f6de80f2000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6de80f62c0 tx=0x7f6de0009d70).stop 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.398 7f6df01a6700 1 -- 172.21.15.57:0/2559050583 shutdown_connections 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.398 7f6df01a6700 1 --2- 172.21.15.57:0/2559050583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de810cd30 0x7f6de80f2000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.398 7f6df01a6700 1 --2- 172.21.15.57:0/2559050583 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80f5890 0x7f6de810c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.398 7f6df01a6700 1 -- 172.21.15.57:0/2559050583 >> 172.21.15.57:0/2559050583 conn(0x7f6de81139e0 msgr2=0x7f6de80f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.398 7f6df01a6700 1 -- 172.21.15.57:0/2559050583 shutdown_connections 2024-04-25T02:06:27.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.398 7f6df01a6700 1 -- 172.21.15.57:0/2559050583 wait complete. 2024-04-25T02:06:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.422 7f6df01a6700 1 Processor -- start 2024-04-25T02:06:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.422 7f6df01a6700 1 -- start start 2024-04-25T02:06:27.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6df01a6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de81a4ec0 0x7f6de80d5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6df01a6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80d5aa0 0x7f6de81b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6df01a6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de80d5ef0 0x7f6de81b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6df01a6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81a4860 con 0x7f6de81a4ec0 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6df01a6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81a5310 con 0x7f6de80d5ef0 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6df01a6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81b3030 con 0x7f6de80d5aa0 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de81a4ec0 0x7f6de80d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de81a4ec0 0x7f6de80d5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56810/0 (socket says 172.21.15.57:56810) 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6ded7a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de80d5ef0 0x7f6de81b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 -- 172.21.15.57:0/2242337430 learned_addr learned my addr 172.21.15.57:0/2242337430 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6de7fff700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80d5aa0 0x7f6de81b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 -- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80d5aa0 msgr2=0x7f6de81b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80d5aa0 0x7f6de81b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 -- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de80d5ef0 msgr2=0x7f6de81b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de80d5ef0 0x7f6de81b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 -- 172.21.15.57:0/2242337430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de81b3260 con 0x7f6de81a4ec0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6ded7a2700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de80d5ef0 0x7f6de81b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6de7fff700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80d5aa0 0x7f6de81b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.423 7f6decfa1700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de81a4ec0 0x7f6de80d5470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f6ddc00c000 tx=0x7f6ddc00ecd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.424 7f6de5ffb700 1 -- 172.21.15.57:0/2242337430 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6de81b3260 con 0x7f6de81a4ec0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.424 7f6de5ffb700 1 -- 172.21.15.57:0/2242337430 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc00ee10 con 0x7f6de81a4ec0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.424 7f6de5ffb700 1 -- 172.21.15.57:0/2242337430 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6ddc00f040 con 0x7f6de81a4ec0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.424 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de81b9ac0 con 0x7f6de81a4ec0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.424 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de81b9ea0 con 0x7f6de81a4ec0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.424 7f6de5ffb700 1 -- 172.21.15.57:0/2242337430 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6ddc011070 con 0x7f6de81a4ec0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.424 7f6de5ffb700 1 -- 172.21.15.57:0/2242337430 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f6ddc010040 con 0x7f6de81a4ec0 2024-04-25T02:06:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.425 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de80f0850 con 0x7f6de81a4ec0 2024-04-25T02:06:27.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.428 7f6de5ffb700 1 -- 172.21.15.57:0/2242337430 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f6ddc00c5a0 con 0x7f6de81a4ec0 2024-04-25T02:06:27.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.573 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6de81acaf0 con 0x7f6de81a4ec0 2024-04-25T02:06:27.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.576 7f6de5ffb700 1 -- 172.21.15.57:0/2242337430 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6ddc000c30 con 0x7f6de81a4ec0 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 >> v1:172.21.15.57:6816/43033 conn(0x7f6dd00145b0 legacy=0x7f6dd0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de81a4ec0 msgr2=0x7f6de80d5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de81a4ec0 0x7f6de80d5470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f6ddc00c000 tx=0x7f6ddc00ecd0).stop 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 shutdown_connections 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6de80d5ef0 0x7f6de81b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6de81a4ec0 0x7f6de80d5470 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 --2- 172.21.15.57:0/2242337430 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6de80d5aa0 0x7f6de81b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 >> 172.21.15.57:0/2242337430 conn(0x7f6de80c5970 msgr2=0x7f6de80d6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:27.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 shutdown_connections 2024-04-25T02:06:27.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.577 7f6df01a6700 1 -- 172.21.15.57:0/2242337430 wait complete. 2024-04-25T02:06:27.585 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2024-04-25T02:06:27.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.720 7f821f8e2700 1 Processor -- start 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.720 7f821f8e2700 1 -- start start 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f821f8e2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82180f5910 0x7f82180f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f821f8e2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180f1eb0 0x7f821810e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f821f8e2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f82180f2300 0x7f821810e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f821f8e2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82180f9220 con 0x7f82180f2300 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f821f8e2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821810ef00 con 0x7f82180f1eb0 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f821f8e2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82181aa650 con 0x7f82180f5910 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f8217fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82180f5910 0x7f82180f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f82177fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180f1eb0 0x7f821810e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f821cede700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f82180f2300 0x7f821810e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f8217fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82180f5910 0x7f82180f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48270/0 (socket says 172.21.15.57:48270) 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f82177fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180f1eb0 0x7f821810e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60692/0 (socket says 172.21.15.57:60692) 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.721 7f8217fff700 1 -- 172.21.15.57:0/2508228451 learned_addr learned my addr 172.21.15.57:0/2508228451 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8217fff700 1 -- 172.21.15.57:0/2508228451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180f1eb0 msgr2=0x7f821810e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8217fff700 1 --2- 172.21.15.57:0/2508228451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180f1eb0 0x7f821810e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8217fff700 1 -- 172.21.15.57:0/2508228451 >> v2:172.21.15.57:3300/0 conn(0x7f82180f2300 msgr2=0x7f821810e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8217fff700 1 --2- 172.21.15.57:0/2508228451 >> v2:172.21.15.57:3300/0 conn(0x7f82180f2300 0x7f821810e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8217fff700 1 -- 172.21.15.57:0/2508228451 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82181aa800 con 0x7f82180f5910 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f821cede700 1 --2- 172.21.15.57:0/2508228451 >> v2:172.21.15.57:3300/0 conn(0x7f82180f2300 0x7f821810e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f82177fe700 1 --2- 172.21.15.57:0/2508228451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180f1eb0 0x7f821810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8217fff700 1 --2- 172.21.15.57:0/2508228451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82180f5910 0x7f82180f1880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8208002f70 tx=0x7f82080099d0).ready entity=mon.2 client_cookie=fd8b324284f864ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8216ffd700 1 -- 172.21.15.57:0/2508228451 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82181aa800 con 0x7f82180f5910 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8216ffd700 1 -- 172.21.15.57:0/2508228451 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800f510 con 0x7f82180f5910 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f8216ffd700 1 -- 172.21.15.57:0/2508228451 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f820800f6f0 con 0x7f82180f5910 2024-04-25T02:06:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f821f8e2700 1 -- 172.21.15.57:0/2508228451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82180f5910 msgr2=0x7f82180f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f821f8e2700 1 --2- 172.21.15.57:0/2508228451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82180f5910 0x7f82180f1880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8208002f70 tx=0x7f82080099d0).stop 2024-04-25T02:06:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f821f8e2700 1 -- 172.21.15.57:0/2508228451 shutdown_connections 2024-04-25T02:06:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f821f8e2700 1 --2- 172.21.15.57:0/2508228451 >> v2:172.21.15.57:3300/0 conn(0x7f82180f2300 0x7f821810e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f821f8e2700 1 --2- 172.21.15.57:0/2508228451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82180f5910 0x7f82180f1880 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.722 7f821f8e2700 1 --2- 172.21.15.57:0/2508228451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180f1eb0 0x7f821810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.723 7f821f8e2700 1 -- 172.21.15.57:0/2508228451 >> 172.21.15.57:0/2508228451 conn(0x7f8218113a60 msgr2=0x7f82180f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:27.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.723 7f821f8e2700 1 -- 172.21.15.57:0/2508228451 shutdown_connections 2024-04-25T02:06:27.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.723 7f821f8e2700 1 -- 172.21.15.57:0/2508228451 wait complete. 2024-04-25T02:06:27.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.746 7f821f8e2700 1 Processor -- start 2024-04-25T02:06:27.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.746 7f821f8e2700 1 -- start start 2024-04-25T02:06:27.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f821f8e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82180cc3d0 0x7f82180cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f821f8e2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180cce50 0x7f82181b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f821f8e2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82181b4c60 0x7f82181b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f821f8e2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180be7f0 con 0x7f82180cc3d0 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f821f8e2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180d4a30 con 0x7f82180cce50 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f821f8e2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82180cf230 con 0x7f82181b4c60 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f82177fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180cce50 0x7f82181b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f8217fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82180cc3d0 0x7f82180cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f82177fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180cce50 0x7f82181b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60694/0 (socket says 172.21.15.57:60694) 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f82177fe700 1 -- 172.21.15.57:0/1218411048 learned_addr learned my addr 172.21.15.57:0/1218411048 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f8217fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82180cc3d0 0x7f82180cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56828/0 (socket says 172.21.15.57:56828) 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f821cede700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82181b4c60 0x7f82181b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f82177fe700 1 -- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82181b4c60 msgr2=0x7f82181b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f82177fe700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82181b4c60 0x7f82181b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f82177fe700 1 -- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82180cc3d0 msgr2=0x7f82180cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f82177fe700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82180cc3d0 0x7f82180cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f82177fe700 1 -- 172.21.15.57:0/1218411048 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180d8a40 con 0x7f82180cce50 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.747 7f821cede700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82181b4c60 0x7f82181b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.748 7f82177fe700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180cce50 0x7f82181b4630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f82180deeb0 tx=0x7f820c00ec50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.748 7f82157fa700 1 -- 172.21.15.57:0/1218411048 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82180d8a40 con 0x7f82180cce50 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.748 7f82157fa700 1 -- 172.21.15.57:0/1218411048 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00c9a0 con 0x7f82180cce50 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.748 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82181bbd20 con 0x7f82180cce50 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.748 7f82157fa700 1 -- 172.21.15.57:0/1218411048 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f820c00f040 con 0x7f82180cce50 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.748 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82181bc100 con 0x7f82180cce50 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.748 7f82157fa700 1 -- 172.21.15.57:0/1218411048 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f820c011070 con 0x7f82180cce50 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.748 7f82157fa700 1 -- 172.21.15.57:0/1218411048 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f820c010040 con 0x7f82180cce50 2024-04-25T02:06:27.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.749 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82180f08d0 con 0x7f82180cce50 2024-04-25T02:06:27.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.752 7f82157fa700 1 -- 172.21.15.57:0/1218411048 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f820c00c5a0 con 0x7f82180cce50 2024-04-25T02:06:27.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.895 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f82181aed30 con 0x7f82180cce50 2024-04-25T02:06:27.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.908 7f82157fa700 1 -- 172.21.15.57:0/1218411048 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f820c000c30 con 0x7f82180cce50 2024-04-25T02:06:27.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 >> v1:172.21.15.57:6816/43033 conn(0x7f81f80145b0 legacy=0x7f81f8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180cce50 msgr2=0x7f82181b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:27.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180cce50 0x7f82181b4630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f82180deeb0 tx=0x7f820c00ec50).stop 2024-04-25T02:06:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 shutdown_connections 2024-04-25T02:06:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f82181b4c60 0x7f82181b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82180cc3d0 0x7f82180cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 --2- 172.21.15.57:0/1218411048 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82180cce50 0x7f82181b4630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 >> 172.21.15.57:0/1218411048 conn(0x7f82180bf710 msgr2=0x7f82180d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.909 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 shutdown_connections 2024-04-25T02:06:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:27.910 7f821f8e2700 1 -- 172.21.15.57:0/1218411048 wait complete. 2024-04-25T02:06:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2024-04-25T02:06:27.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T02:06:28.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f3960ff4700 1 Processor -- start 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f3960ff4700 1 -- start start 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f3960ff4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0f5910 0x7f395c10c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f3960ff4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c10cdb0 0x7f395c0f2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f3960ff4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395c0f26b0 con 0x7f395c10c960 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f3960ff4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0fa280 con 0x7f395c10cdb0 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f3960ff4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0f95b0 con 0x7f395c0f5910 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f3959d9f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0f5910 0x7f395c10c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f395959e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f395c10c960 0x7f395c0f1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55616/0 (socket says 172.21.15.57:55616) 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f395959e700 1 -- 172.21.15.57:0/1765706224 learned_addr learned my addr 172.21.15.57:0/1765706224 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:28.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.054 7f395a5a0700 1 --2- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c10cdb0 0x7f395c0f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f395a5a0700 1 -- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0f5910 msgr2=0x7f395c10c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f395a5a0700 1 --2- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0f5910 0x7f395c10c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f395a5a0700 1 -- 172.21.15.57:0/1765706224 >> v1:172.21.15.57:6789/0 conn(0x7f395c10c960 legacy=0x7f395c0f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f395a5a0700 1 -- 172.21.15.57:0/1765706224 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c1aa5d0 con 0x7f395c10cdb0 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f3958d9d700 1 -- 172.21.15.57:0/1765706224 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396250316 0 0) 0x7f3950001110 con 0x7f395c10c960 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f3959d9f700 1 --2- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0f5910 0x7f395c10c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f395a5a0700 1 --2- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c10cdb0 0x7f395c0f2080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f395c0f6340 tx=0x7f3954009d70).ready entity=mon.1 client_cookie=6f12fd3e5315e9bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f3958d9d700 1 -- 172.21.15.57:0/1765706224 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f395c1aa5d0 con 0x7f395c10cdb0 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f3958d9d700 1 -- 172.21.15.57:0/1765706224 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395400b7c0 con 0x7f395c10cdb0 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f3958d9d700 1 -- 172.21.15.57:0/1765706224 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f395400b9a0 con 0x7f395c10cdb0 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f3960ff4700 1 -- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c10cdb0 msgr2=0x7f395c0f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.055 7f3960ff4700 1 --2- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c10cdb0 0x7f395c0f2080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f395c0f6340 tx=0x7f3954009d70).stop 2024-04-25T02:06:28.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.056 7f3960ff4700 1 -- 172.21.15.57:0/1765706224 shutdown_connections 2024-04-25T02:06:28.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.056 7f3960ff4700 1 --2- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c10cdb0 0x7f395c0f2080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.056 7f3960ff4700 1 --2- 172.21.15.57:0/1765706224 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0f5910 0x7f395c10c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.056 7f3960ff4700 1 -- 172.21.15.57:0/1765706224 >> 172.21.15.57:0/1765706224 conn(0x7f395c113a60 msgr2=0x7f395c0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:28.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.056 7f3960ff4700 1 -- 172.21.15.57:0/1765706224 shutdown_connections 2024-04-25T02:06:28.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.056 7f3960ff4700 1 -- 172.21.15.57:0/1765706224 wait complete. 2024-04-25T02:06:28.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3960ff4700 1 Processor -- start 2024-04-25T02:06:28.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3960ff4700 1 -- start start 2024-04-25T02:06:28.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3960ff4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c0cf810 0x7f395c0d6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3960ff4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f395c0d6780 0x7f395c1b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3960ff4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0d6bd0 0x7f395c1b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3960ff4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0cd6c0 con 0x7f395c0d6780 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3960ff4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0cfc60 con 0x7f395c0cf810 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3960ff4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0cd2a0 con 0x7f395c0d6bd0 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f395959e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f395c0d6780 0x7f395c1b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f395a5a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0d6bd0 0x7f395c1b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3959d9f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c0cf810 0x7f395c0d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f395a5a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0d6bd0 0x7f395c1b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48296/0 (socket says 172.21.15.57:48296) 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f395959e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f395c0d6780 0x7f395c1b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56830/0 (socket says 172.21.15.57:56830) 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f395a5a0700 1 -- 172.21.15.57:0/4194498743 learned_addr learned my addr 172.21.15.57:0/4194498743 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3959d9f700 1 -- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0d6bd0 msgr2=0x7f395c1b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3959d9f700 1 --2- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0d6bd0 0x7f395c1b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3959d9f700 1 -- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f395c0d6780 msgr2=0x7f395c1b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3959d9f700 1 --2- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f395c0d6780 0x7f395c1b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.080 7f3959d9f700 1 -- 172.21.15.57:0/4194498743 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c1b2d90 con 0x7f395c0cf810 2024-04-25T02:06:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.081 7f3959d9f700 1 --2- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c0cf810 0x7f395c0d6150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f395c0d7690 tx=0x7f394c00ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.081 7f394affd700 1 -- 172.21.15.57:0/4194498743 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f395c1b2d90 con 0x7f395c0cf810 2024-04-25T02:06:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.081 7f394affd700 1 -- 172.21.15.57:0/4194498743 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c00c790 con 0x7f395c0cf810 2024-04-25T02:06:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.081 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c1b30b0 con 0x7f395c0cf810 2024-04-25T02:06:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.081 7f394affd700 1 -- 172.21.15.57:0/4194498743 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f394c00f040 con 0x7f395c0cf810 2024-04-25T02:06:28.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.081 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c1b9a00 con 0x7f395c0cf810 2024-04-25T02:06:28.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.081 7f394affd700 1 -- 172.21.15.57:0/4194498743 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f394c011070 con 0x7f395c0cf810 2024-04-25T02:06:28.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.081 7f394affd700 1 -- 172.21.15.57:0/4194498743 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f394c010040 con 0x7f395c0cf810 2024-04-25T02:06:28.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.082 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395c0f08d0 con 0x7f395c0cf810 2024-04-25T02:06:28.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.085 7f394affd700 1 -- 172.21.15.57:0/4194498743 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f394c00ee10 con 0x7f395c0cf810 2024-04-25T02:06:28.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.232 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f395c1ac850 con 0x7f395c0cf810 2024-04-25T02:06:28.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.240 7f394affd700 1 -- 172.21.15.57:0/4194498743 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f394c000c30 con 0x7f395c0cf810 2024-04-25T02:06:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 >> v1:172.21.15.57:6816/43033 conn(0x7f39380145b0 legacy=0x7f3938016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c0cf810 msgr2=0x7f395c0d6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 --2- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c0cf810 0x7f395c0d6150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f395c0d7690 tx=0x7f394c00ecd0).stop 2024-04-25T02:06:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 shutdown_connections 2024-04-25T02:06:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 --2- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f395c0d6bd0 0x7f395c1b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 --2- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f395c0cf810 0x7f395c0d6150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 --2- 172.21.15.57:0/4194498743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f395c0d6780 0x7f395c1b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 >> 172.21.15.57:0/4194498743 conn(0x7f395c0c3a10 msgr2=0x7f395c0daf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:28.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 shutdown_connections 2024-04-25T02:06:28.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.242 7f3960ff4700 1 -- 172.21.15.57:0/4194498743 wait complete. 2024-04-25T02:06:28.250 INFO:teuthology.orchestra.run.smithi057.stderr:updated 2024-04-25T02:06:28.260 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:28.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.383 7f7daa380700 1 Processor -- start 2024-04-25T02:06:28.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7daa380700 1 -- start start 2024-04-25T02:06:28.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7daa380700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7da40f5920 0x7f7da410c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7daa380700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da410cdc0 0x7f7da40f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7daa380700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da40f26c0 con 0x7f7da410c970 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7daa380700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da40fa290 con 0x7f7da40f5920 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7daa380700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40f95c0 con 0x7f7da410cdc0 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da3086700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7da40f5920 0x7f7da410c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da2885700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7da410c970 0x7f7da40f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55630/0 (socket says 172.21.15.57:55630) 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da2885700 1 -- 172.21.15.57:0/2348237311 learned_addr learned my addr 172.21.15.57:0/2348237311 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da3887700 1 --2- 172.21.15.57:0/2348237311 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da410cdc0 0x7f7da40f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da3086700 1 -- 172.21.15.57:0/2348237311 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da410cdc0 msgr2=0x7f7da40f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da3086700 1 --2- 172.21.15.57:0/2348237311 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da410cdc0 0x7f7da40f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da3086700 1 -- 172.21.15.57:0/2348237311 >> v1:172.21.15.57:6789/0 conn(0x7f7da410c970 legacy=0x7f7da40f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da3086700 1 -- 172.21.15.57:0/2348237311 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da41aa5e0 con 0x7f7da40f5920 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.384 7f7da2084700 1 -- 172.21.15.57:0/2348237311 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725230045 0 0) 0x7f7d8c001110 con 0x7f7da410c970 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7da3086700 1 --2- 172.21.15.57:0/2348237311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40f5920 0x7f7da410c340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7da4113400 tx=0x7f7d9400ba20).ready entity=mon.0 client_cookie=d6a99c40d7ffda78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7da2084700 1 -- 172.21.15.57:0/2348237311 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7da41aa5e0 con 0x7f7da40f5920 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7da2084700 1 -- 172.21.15.57:0/2348237311 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9400d5c0 con 0x7f7da40f5920 2024-04-25T02:06:28.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7da2084700 1 -- 172.21.15.57:0/2348237311 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d9400d990 con 0x7f7da40f5920 2024-04-25T02:06:28.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7daa380700 1 -- 172.21.15.57:0/2348237311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40f5920 msgr2=0x7f7da410c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7daa380700 1 --2- 172.21.15.57:0/2348237311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40f5920 0x7f7da410c340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7da4113400 tx=0x7f7d9400ba20).stop 2024-04-25T02:06:28.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7daa380700 1 -- 172.21.15.57:0/2348237311 shutdown_connections 2024-04-25T02:06:28.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7daa380700 1 --2- 172.21.15.57:0/2348237311 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da410cdc0 0x7f7da40f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7daa380700 1 --2- 172.21.15.57:0/2348237311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40f5920 0x7f7da410c340 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7daa380700 1 -- 172.21.15.57:0/2348237311 >> 172.21.15.57:0/2348237311 conn(0x7f7da4113a70 msgr2=0x7f7da40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:28.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7daa380700 1 -- 172.21.15.57:0/2348237311 shutdown_connections 2024-04-25T02:06:28.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.385 7f7daa380700 1 -- 172.21.15.57:0/2348237311 wait complete. 2024-04-25T02:06:28.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.409 7f7daa380700 1 Processor -- start 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.409 7f7daa380700 1 -- start start 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7daa380700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da41adcb0 0x7f7da41ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7daa380700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da41ae730 0x7f7da41b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7daa380700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da41b4c90 0x7f7da41b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7daa380700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40f6390 con 0x7f7da41ae730 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7daa380700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da41b5710 con 0x7f7da41b4c90 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7daa380700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40f65a0 con 0x7f7da41adcb0 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da41ae730 0x7f7da41b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da3086700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da41adcb0 0x7f7da41ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da3887700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da41b4c90 0x7f7da41b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da41ae730 0x7f7da41b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56846/0 (socket says 172.21.15.57:56846) 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 -- 172.21.15.57:0/1362521708 learned_addr learned my addr 172.21.15.57:0/1362521708 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:28.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 -- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da41adcb0 msgr2=0x7f7da41ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da41adcb0 0x7f7da41ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 -- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da41b4c90 msgr2=0x7f7da41b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da41b4c90 0x7f7da41b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 -- 172.21.15.57:0/1362521708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da40f0200 con 0x7f7da41ae730 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da3887700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da41b4c90 0x7f7da41b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da3086700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da41adcb0 0x7f7da41ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da2885700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da41ae730 0x7f7da41b4660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7da40f84f0 tx=0x7f7d8c00c860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da0881700 1 -- 172.21.15.57:0/1362521708 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7da40f0200 con 0x7f7da41ae730 2024-04-25T02:06:28.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da0881700 1 -- 172.21.15.57:0/1362521708 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8c00ce10 con 0x7f7da41ae730 2024-04-25T02:06:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7da0881700 1 -- 172.21.15.57:0/1362521708 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7d8c005620 con 0x7f7da41ae730 2024-04-25T02:06:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7daa380700 1 -- 172.21.15.57:0/1362521708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da40d5fa0 con 0x7f7da41ae730 2024-04-25T02:06:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.410 7f7daa380700 1 -- 172.21.15.57:0/1362521708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da41bbde0 con 0x7f7da41ae730 2024-04-25T02:06:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.411 7f7da0881700 1 -- 172.21.15.57:0/1362521708 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7d8c005820 con 0x7f7da41ae730 2024-04-25T02:06:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.411 7f7da0881700 1 -- 172.21.15.57:0/1362521708 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7f7d8c0144d0 con 0x7f7da41ae730 2024-04-25T02:06:28.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.411 7f7daa380700 1 -- 172.21.15.57:0/1362521708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da40f08e0 con 0x7f7da41ae730 2024-04-25T02:06:28.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.415 7f7da0881700 1 -- 172.21.15.57:0/1362521708 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7d8c0070d0 con 0x7f7da41ae730 2024-04-25T02:06:28.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.525 7f7daa380700 1 -- 172.21.15.57:0/1362521708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7da41aed80 con 0x7f7da41ae730 2024-04-25T02:06:28.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.526 7f7da0881700 1 -- 172.21.15.57:0/1362521708 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+5875 (secure 0 0 0) 0x7f7d8c000c30 con 0x7f7da41ae730 2024-04-25T02:06:28.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:28.533 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":21,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:25.894227","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 -- 172.21.15.57:0/1362521708 >> v1:172.21.15.57:6816/43033 conn(0x7f7d880145b0 legacy=0x7f7d88016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 -- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da41ae730 msgr2=0x7f7da41b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da41ae730 0x7f7da41b4660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7da40f84f0 tx=0x7f7d8c00c860).stop 2024-04-25T02:06:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 -- 172.21.15.57:0/1362521708 shutdown_connections 2024-04-25T02:06:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da41b4c90 0x7f7da41b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da41adcb0 0x7f7da41ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 --2- 172.21.15.57:0/1362521708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da41ae730 0x7f7da41b4660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 -- 172.21.15.57:0/1362521708 >> 172.21.15.57:0/1362521708 conn(0x7f7da40c6d00 msgr2=0x7f7da41a6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:28.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 -- 172.21.15.57:0/1362521708 shutdown_connections 2024-04-25T02:06:28.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.527 7f7daa380700 1 -- 172.21.15.57:0/1362521708 wait complete. 2024-04-25T02:06:28.545 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-25T02:06:28.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:28.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.672 7faff94b9700 1 Processor -- start 2024-04-25T02:06:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.672 7faff94b9700 1 -- start start 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff94b9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40f5920 0x7faff40f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff94b9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faff40f1ec0 0x7faff410e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff94b9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40f2310 0x7faff410e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff94b9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40f9230 con 0x7faff40f1ec0 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff94b9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff410ef10 con 0x7faff40f5920 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff94b9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff41aa660 con 0x7faff40f2310 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff2ab2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40f2310 0x7faff410e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff2ab2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40f2310 0x7faff410e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48340/0 (socket says 172.21.15.57:48340) 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff2ab2700 1 -- 172.21.15.57:0/4166483289 learned_addr learned my addr 172.21.15.57:0/4166483289 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff2ab2700 1 -- 172.21.15.57:0/4166483289 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40f5920 msgr2=0x7faff40f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff2ab2700 1 --2- 172.21.15.57:0/4166483289 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40f5920 0x7faff40f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff2ab2700 1 -- 172.21.15.57:0/4166483289 >> v2:172.21.15.57:3300/0 conn(0x7faff40f1ec0 msgr2=0x7faff410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff2ab2700 1 --2- 172.21.15.57:0/4166483289 >> v2:172.21.15.57:3300/0 conn(0x7faff40f1ec0 0x7faff410e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.673 7faff2ab2700 1 -- 172.21.15.57:0/4166483289 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff41aa810 con 0x7faff40f2310 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff2ab2700 1 --2- 172.21.15.57:0/4166483289 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40f2310 0x7faff410e8e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fafec0032f0 tx=0x7fafec009d60).ready entity=mon.2 client_cookie=7bbe1bca8d2e6f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff12af700 1 -- 172.21.15.57:0/4166483289 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faff41aa810 con 0x7faff40f2310 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff12af700 1 -- 172.21.15.57:0/4166483289 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec00b880 con 0x7faff40f2310 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff12af700 1 -- 172.21.15.57:0/4166483289 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafec00ba60 con 0x7faff40f2310 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff94b9700 1 -- 172.21.15.57:0/4166483289 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40f2310 msgr2=0x7faff410e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff94b9700 1 --2- 172.21.15.57:0/4166483289 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40f2310 0x7faff410e8e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fafec0032f0 tx=0x7fafec009d60).stop 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff94b9700 1 -- 172.21.15.57:0/4166483289 shutdown_connections 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff94b9700 1 --2- 172.21.15.57:0/4166483289 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40f2310 0x7faff410e8e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff94b9700 1 --2- 172.21.15.57:0/4166483289 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40f5920 0x7faff40f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff94b9700 1 --2- 172.21.15.57:0/4166483289 >> v2:172.21.15.57:3300/0 conn(0x7faff40f1ec0 0x7faff410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff94b9700 1 -- 172.21.15.57:0/4166483289 >> 172.21.15.57:0/4166483289 conn(0x7faff4113a70 msgr2=0x7faff40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.674 7faff94b9700 1 -- 172.21.15.57:0/4166483289 shutdown_connections 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.675 7faff94b9700 1 -- 172.21.15.57:0/4166483289 wait complete. 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.698 7faff94b9700 1 Processor -- start 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.698 7faff94b9700 1 -- start start 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff94b9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40df1c0 0x7faff40df610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff94b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff40dfc40 0x7faff40cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff94b9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40cfa30 0x7faff41bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff94b9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40be580 con 0x7faff40dfc40 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff94b9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff40e0a50 con 0x7faff40cfa30 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff94b9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff40da470 con 0x7faff40df1c0 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40df1c0 0x7faff40df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff1ab0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff40dfc40 0x7faff40cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40df1c0 0x7faff40df610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48348/0 (socket says 172.21.15.57:48348) 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 -- 172.21.15.57:0/1585381476 learned_addr learned my addr 172.21.15.57:0/1585381476 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:28.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff1ab0700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff40dfc40 0x7faff40cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56854/0 (socket says 172.21.15.57:56854) 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff2ab2700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40cfa30 0x7faff41bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 -- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40cfa30 msgr2=0x7faff41bbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40cfa30 0x7faff41bbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 -- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff40dfc40 msgr2=0x7faff40cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff40dfc40 0x7faff40cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 -- 172.21.15.57:0/1585381476 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40cfe80 con 0x7faff40df1c0 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff1ab0700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff40dfc40 0x7faff40cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.699 7faff22b1700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40df1c0 0x7faff40df610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7faff40be480 tx=0x7fafe4009810).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.700 7fafeb7fe700 1 -- 172.21.15.57:0/1585381476 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faff40cfe80 con 0x7faff40df1c0 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.700 7fafeb7fe700 1 -- 172.21.15.57:0/1585381476 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe4012410 con 0x7faff40df1c0 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.700 7fafeb7fe700 1 -- 172.21.15.57:0/1585381476 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fafe40127e0 con 0x7faff40df1c0 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.700 7faff94b9700 1 -- 172.21.15.57:0/1585381476 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff40d01a0 con 0x7faff40df1c0 2024-04-25T02:06:28.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.700 7faff94b9700 1 -- 172.21.15.57:0/1585381476 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff41bc3b0 con 0x7faff40df1c0 2024-04-25T02:06:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.700 7fafeb7fe700 1 -- 172.21.15.57:0/1585381476 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fafe4019020 con 0x7faff40df1c0 2024-04-25T02:06:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.700 7fafeb7fe700 1 -- 172.21.15.57:0/1585381476 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fafe40060f0 con 0x7faff40df1c0 2024-04-25T02:06:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.701 7faff94b9700 1 -- 172.21.15.57:0/1585381476 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff40f08e0 con 0x7faff40df1c0 2024-04-25T02:06:28.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.704 7fafeb7fe700 1 -- 172.21.15.57:0/1585381476 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fafe40020d0 con 0x7faff40df1c0 2024-04-25T02:06:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.814 7faff94b9700 1 -- 172.21.15.57:0/1585381476 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faff41aebd0 con 0x7faff40df1c0 2024-04-25T02:06:28.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.814 7fafeb7fe700 1 -- 172.21.15.57:0/1585381476 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fafe4000c30 con 0x7faff40df1c0 2024-04-25T02:06:28.821 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.815 7faff94b9700 1 -- 172.21.15.57:0/1585381476 >> v1:172.21.15.57:6816/43033 conn(0x7fafd80145b0 legacy=0x7fafd8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.815 7faff94b9700 1 -- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40df1c0 msgr2=0x7faff40df610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.815 7faff94b9700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40df1c0 0x7faff40df610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7faff40be480 tx=0x7fafe4009810).stop 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.815 7faff94b9700 1 -- 172.21.15.57:0/1585381476 shutdown_connections 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.815 7faff94b9700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff40cfa30 0x7faff41bbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.815 7faff94b9700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff40df1c0 0x7faff40df610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.816 7faff94b9700 1 --2- 172.21.15.57:0/1585381476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff40dfc40 0x7faff40cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.816 7faff94b9700 1 -- 172.21.15.57:0/1585381476 >> 172.21.15.57:0/1585381476 conn(0x7faff40bf5d0 msgr2=0x7faff40d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.816 7faff94b9700 1 -- 172.21.15.57:0/1585381476 shutdown_connections 2024-04-25T02:06:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.816 7faff94b9700 1 -- 172.21.15.57:0/1585381476 wait complete. 2024-04-25T02:06:28.833 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:06:28.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.959 7fac0c584700 1 Processor -- start 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0c584700 1 -- start start 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0c584700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040f5a10 0x7fac0410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0c584700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0410b740 0x7fac0419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0c584700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fac0410bb90 0x7fac041a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0c584700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac040fa590 con 0x7fac0410bb90 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0c584700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac041a08a0 con 0x7fac0410b740 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0c584700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac041a0ad0 con 0x7fac040f5a10 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0937f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040f5a10 0x7fac0410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac08b7e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0410b740 0x7fac0419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac09b80700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fac0410bb90 0x7fac041a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac08b7e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0410b740 0x7fac0419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60754/0 (socket says 172.21.15.57:60754) 2024-04-25T02:06:28.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac08b7e700 1 -- 172.21.15.57:0/114069791 learned_addr learned my addr 172.21.15.57:0/114069791 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac0937f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040f5a10 0x7fac0410b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48352/0 (socket says 172.21.15.57:48352) 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac08b7e700 1 -- 172.21.15.57:0/114069791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040f5a10 msgr2=0x7fac0410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac08b7e700 1 --2- 172.21.15.57:0/114069791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040f5a10 0x7fac0410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac08b7e700 1 -- 172.21.15.57:0/114069791 >> v2:172.21.15.57:3300/0 conn(0x7fac0410bb90 msgr2=0x7fac041a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac08b7e700 1 --2- 172.21.15.57:0/114069791 >> v2:172.21.15.57:3300/0 conn(0x7fac0410bb90 0x7fac041a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.960 7fac08b7e700 1 -- 172.21.15.57:0/114069791 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac041a73b0 con 0x7fac0410b740 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fac09b80700 1 --2- 172.21.15.57:0/114069791 >> v2:172.21.15.57:3300/0 conn(0x7fac0410bb90 0x7fac041a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fac0937f700 1 --2- 172.21.15.57:0/114069791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040f5a10 0x7fac0410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fac08b7e700 1 --2- 172.21.15.57:0/114069791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0410b740 0x7fac0419fc40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fabf4002f70 tx=0x7fabf400bc80).ready entity=mon.1 client_cookie=2b952ef2f0269b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fabf3fff700 1 -- 172.21.15.57:0/114069791 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fac041a73b0 con 0x7fac0410b740 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fabf3fff700 1 -- 172.21.15.57:0/114069791 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400dc00 con 0x7fac0410b740 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fabf3fff700 1 -- 172.21.15.57:0/114069791 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fabf4010470 con 0x7fac0410b740 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fac0c584700 1 -- 172.21.15.57:0/114069791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0410b740 msgr2=0x7fac0419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fac0c584700 1 --2- 172.21.15.57:0/114069791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0410b740 0x7fac0419fc40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fabf4002f70 tx=0x7fabf400bc80).stop 2024-04-25T02:06:28.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.961 7fac0c584700 1 -- 172.21.15.57:0/114069791 shutdown_connections 2024-04-25T02:06:28.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.962 7fac0c584700 1 --2- 172.21.15.57:0/114069791 >> v2:172.21.15.57:3300/0 conn(0x7fac0410bb90 0x7fac041a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.962 7fac0c584700 1 --2- 172.21.15.57:0/114069791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040f5a10 0x7fac0410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.962 7fac0c584700 1 --2- 172.21.15.57:0/114069791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0410b740 0x7fac0419fc40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.962 7fac0c584700 1 -- 172.21.15.57:0/114069791 >> 172.21.15.57:0/114069791 conn(0x7fac04113a70 msgr2=0x7fac040f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:28.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.962 7fac0c584700 1 -- 172.21.15.57:0/114069791 shutdown_connections 2024-04-25T02:06:28.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.962 7fac0c584700 1 -- 172.21.15.57:0/114069791 wait complete. 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0c584700 1 Processor -- start 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0c584700 1 -- start start 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0c584700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac040d8e80 0x7fac040d1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0c584700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac040d1e90 0x7fac041afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0c584700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040d22e0 0x7fac041b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0c584700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac040f0210 con 0x7fac040d8e80 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0c584700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac040d8640 con 0x7fac040d1e90 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0c584700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac040c38c0 con 0x7fac040d22e0 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0937f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac040d8e80 0x7fac040d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac09b80700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040d22e0 0x7fac041b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0937f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac040d8e80 0x7fac040d1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56878/0 (socket says 172.21.15.57:56878) 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac09b80700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040d22e0 0x7fac041b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48362/0 (socket says 172.21.15.57:48362) 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac0937f700 1 -- 172.21.15.57:0/486727388 learned_addr learned my addr 172.21.15.57:0/486727388 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.986 7fac08b7e700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac040d1e90 0x7fac041afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac0937f700 1 -- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040d22e0 msgr2=0x7fac041b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac0937f700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040d22e0 0x7fac041b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac0937f700 1 -- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac040d1e90 msgr2=0x7fac041afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac0937f700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac040d1e90 0x7fac041afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:28.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac0937f700 1 -- 172.21.15.57:0/486727388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac041b0960 con 0x7fac040d8e80 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac08b7e700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac040d1e90 0x7fac041afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac09b80700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040d22e0 0x7fac041b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac0937f700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac040d8e80 0x7fac040d1860 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fac041ac7b0 tx=0x7fac0000ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fabf27fc700 1 -- 172.21.15.57:0/486727388 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fac041b0960 con 0x7fac040d8e80 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fabf27fc700 1 -- 172.21.15.57:0/486727388 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000c940 con 0x7fac040d8e80 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fabf27fc700 1 -- 172.21.15.57:0/486727388 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fac0000f040 con 0x7fac040d8e80 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac0c584700 1 -- 172.21.15.57:0/486727388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac041b0c20 con 0x7fac040d8e80 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fac0c584700 1 -- 172.21.15.57:0/486727388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac041b7650 con 0x7fac040d8e80 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fabf27fc700 1 -- 172.21.15.57:0/486727388 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fac00011070 con 0x7fac040d8e80 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.987 7fabf27fc700 1 -- 172.21.15.57:0/486727388 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fac00010040 con 0x7fac040d8e80 2024-04-25T02:06:28.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.988 7fac0c584700 1 -- 172.21.15.57:0/486727388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac040f08e0 con 0x7fac040d8e80 2024-04-25T02:06:28.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:28.991 7fabf27fc700 1 -- 172.21.15.57:0/486727388 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fac0000c540 con 0x7fac040d8e80 2024-04-25T02:06:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.103 7fac0c584700 1 -- 172.21.15.57:0/486727388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fac041aa530 con 0x7fac040d8e80 2024-04-25T02:06:29.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.104 7fabf27fc700 1 -- 172.21.15.57:0/486727388 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+64 (secure 0 0 0) 0x7fac00000c30 con 0x7fac040d8e80 2024-04-25T02:06:29.111 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:29.111 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2024-04-25T02:06:29.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T02:06:29.111 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2024-04-25T02:06:29.111 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2024-04-25T02:06:29.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T02:06:29.111 INFO:teuthology.orchestra.run.smithi057.stdout:] 2024-04-25T02:06:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 -- 172.21.15.57:0/486727388 >> v1:172.21.15.57:6816/43033 conn(0x7fabe40145b0 legacy=0x7fabe4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 -- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac040d8e80 msgr2=0x7fac040d1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac040d8e80 0x7fac040d1860 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fac041ac7b0 tx=0x7fac0000ed00).stop 2024-04-25T02:06:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 -- 172.21.15.57:0/486727388 shutdown_connections 2024-04-25T02:06:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fac040d22e0 0x7fac041b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac040d8e80 0x7fac040d1860 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 --2- 172.21.15.57:0/486727388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac040d1e90 0x7fac041afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 -- 172.21.15.57:0/486727388 >> 172.21.15.57:0/486727388 conn(0x7fac040c3440 msgr2=0x7fac040c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 -- 172.21.15.57:0/486727388 shutdown_connections 2024-04-25T02:06:29.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.105 7fac0c584700 1 -- 172.21.15.57:0/486727388 wait complete. 2024-04-25T02:06:29.123 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:06:29.123 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:06:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.252 7fdc4556f700 1 Processor -- start 2024-04-25T02:06:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.252 7fdc4556f700 1 -- start start 2024-04-25T02:06:29.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc4556f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400f5910 0x7fdc4010c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc4556f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdc4010c960 0x7fdc400f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc4556f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc400f26b0 con 0x7fdc4010cdb0 2024-04-25T02:06:29.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc4556f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc400fa280 con 0x7fdc4010c960 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc4556f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400f95b0 con 0x7fdc400f5910 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3e2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400f5910 0x7fdc4010c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3dab0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdc4010c960 0x7fdc400f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3eab2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdc4010cdb0 0x7fdc400f1eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55640/0 (socket says 172.21.15.57:55640) 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3eab2700 1 -- 172.21.15.57:0/4226083581 learned_addr learned my addr 172.21.15.57:0/4226083581 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3dab0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdc4010c960 0x7fdc400f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56882/0 (socket says 172.21.15.57:56882) 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3e2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400f5910 0x7fdc4010c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60766/0 (socket says 172.21.15.57:60766) 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3dab0700 1 -- 172.21.15.57:0/4226083581 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400f5910 msgr2=0x7fdc4010c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3dab0700 1 --2- 172.21.15.57:0/4226083581 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400f5910 0x7fdc4010c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3dab0700 1 -- 172.21.15.57:0/4226083581 >> v1:172.21.15.57:6789/0 conn(0x7fdc4010cdb0 legacy=0x7fdc400f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3dab0700 1 -- 172.21.15.57:0/4226083581 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc401aa5d0 con 0x7fdc4010c960 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3d2af700 1 -- 172.21.15.57:0/4226083581 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579199420 0 0) 0x7fdc38001490 con 0x7fdc4010cdb0 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.253 7fdc3dab0700 1 --2- 172.21.15.57:0/4226083581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc4010c960 0x7fdc400f1880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fdc401133f0 tx=0x7fdc3400ba20).ready entity=mon.0 client_cookie=6ec1134cd0b1f6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc3d2af700 1 -- 172.21.15.57:0/4226083581 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc401aa5d0 con 0x7fdc4010c960 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc3d2af700 1 -- 172.21.15.57:0/4226083581 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3400d5c0 con 0x7fdc4010c960 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc3d2af700 1 -- 172.21.15.57:0/4226083581 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc3400d990 con 0x7fdc4010c960 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc4556f700 1 -- 172.21.15.57:0/4226083581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc4010c960 msgr2=0x7fdc400f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc4556f700 1 --2- 172.21.15.57:0/4226083581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc4010c960 0x7fdc400f1880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fdc401133f0 tx=0x7fdc3400ba20).stop 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc4556f700 1 -- 172.21.15.57:0/4226083581 shutdown_connections 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc4556f700 1 --2- 172.21.15.57:0/4226083581 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400f5910 0x7fdc4010c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc4556f700 1 --2- 172.21.15.57:0/4226083581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc4010c960 0x7fdc400f1880 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc4556f700 1 -- 172.21.15.57:0/4226083581 >> 172.21.15.57:0/4226083581 conn(0x7fdc40113a60 msgr2=0x7fdc400f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc4556f700 1 -- 172.21.15.57:0/4226083581 shutdown_connections 2024-04-25T02:06:29.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.254 7fdc4556f700 1 -- 172.21.15.57:0/4226083581 wait complete. 2024-04-25T02:06:29.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.278 7fdc4556f700 1 Processor -- start 2024-04-25T02:06:29.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.278 7fdc4556f700 1 -- start start 2024-04-25T02:06:29.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc4556f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc400d5310 0x7fdc400d5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc4556f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc400d5d90 0x7fdc400db1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc4556f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400db7d0 0x7fdc400dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc4556f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400a26c0 con 0x7fdc400d5d90 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc4556f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400dd3d0 con 0x7fdc400db7d0 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc4556f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400dc890 con 0x7fdc400d5310 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc400d5d90 0x7fdc400db1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc400d5d90 0x7fdc400db1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56898/0 (socket says 172.21.15.57:56898) 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3e2b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc400d5310 0x7fdc400d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 -- 172.21.15.57:0/1240877988 learned_addr learned my addr 172.21.15.57:0/1240877988 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3eab2700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400db7d0 0x7fdc400dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 -- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc400d5310 msgr2=0x7fdc400d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc400d5310 0x7fdc400d5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 -- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400db7d0 msgr2=0x7fdc400dbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400db7d0 0x7fdc400dbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 -- 172.21.15.57:0/1240877988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc400dc250 con 0x7fdc400d5d90 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3e2b1700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc400d5310 0x7fdc400d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc3dab0700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc400d5d90 0x7fdc400db1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fdc401a7530 tx=0x7fdc340068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc2f7fe700 1 -- 172.21.15.57:0/1240877988 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc400dc250 con 0x7fdc400d5d90 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc2f7fe700 1 -- 172.21.15.57:0/1240877988 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc34011980 con 0x7fdc400d5d90 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc400d7240 con 0x7fdc400d5d90 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.279 7fdc2f7fe700 1 -- 172.21.15.57:0/1240877988 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdc34017040 con 0x7fdc400d5d90 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.280 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc400f6560 con 0x7fdc400d5d90 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.280 7fdc2f7fe700 1 -- 172.21.15.57:0/1240877988 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fdc340273b0 con 0x7fdc400d5d90 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.280 7fdc2f7fe700 1 -- 172.21.15.57:0/1240877988 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fdc34018070 con 0x7fdc400d5d90 2024-04-25T02:06:29.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.281 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc400f08d0 con 0x7fdc400d5d90 2024-04-25T02:06:29.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.284 7fdc2f7fe700 1 -- 172.21.15.57:0/1240877988 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fdc34011770 con 0x7fdc400d5d90 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.395 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 >> v1:172.21.15.57:6816/43033 conn(0x7fdc1c0145b0 legacy=0x7fdc1c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.395 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc400d5d90 msgr2=0x7fdc400db1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.395 7fdc4556f700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc400d5d90 0x7fdc400db1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fdc401a7530 tx=0x7fdc340068c0).stop 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.395 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 shutdown_connections 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.395 7fdc4556f700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc400db7d0 0x7fdc400dbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.395 7fdc4556f700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc400d5310 0x7fdc400d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.395 7fdc4556f700 1 --2- 172.21.15.57:0/1240877988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc400d5d90 0x7fdc400db1a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.396 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 >> 172.21.15.57:0/1240877988 conn(0x7fdc400c6c70 msgr2=0x7fdc400c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.396 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 shutdown_connections 2024-04-25T02:06:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.396 7fdc4556f700 1 -- 172.21.15.57:0/1240877988 wait complete. 2024-04-25T02:06:29.404 INFO:teuthology.orchestra.run.smithi057.stderr:Invalid command: missing required parameter pg_num() 2024-04-25T02:06:29.404 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool create {} {replicated|erasure} {} {} {} {} {} {} {} : create pool 2024-04-25T02:06:29.404 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: invalid command 2024-04-25T02:06:29.415 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T02:06:29.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 2024-04-25T02:06:29.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.543 7fa09cc4d700 1 Processor -- start 2024-04-25T02:06:29.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.543 7fa09cc4d700 1 -- start start 2024-04-25T02:06:29.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09cc4d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980f5a10 0x7fa09810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09cc4d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa09810b740 0x7fa09819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09cc4d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0981a0a70 con 0x7fa09810bb90 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09cc4d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980fa590 con 0x7fa09810b740 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09cc4d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0981a0c90 con 0x7fa0980f5a10 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa095850700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980f5a10 0x7fa09810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09504f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa09810b740 0x7fa09819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa096051700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa09810bb90 0x7fa0981a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55642/0 (socket says 172.21.15.57:55642) 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09504f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa09810b740 0x7fa09819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60786/0 (socket says 172.21.15.57:60786) 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09504f700 1 -- 172.21.15.57:0/197891474 learned_addr learned my addr 172.21.15.57:0/197891474 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa095850700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980f5a10 0x7fa09810b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48382/0 (socket says 172.21.15.57:48382) 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa095850700 1 -- 172.21.15.57:0/197891474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa09810b740 msgr2=0x7fa09819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa095850700 1 --2- 172.21.15.57:0/197891474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa09810b740 0x7fa09819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa095850700 1 -- 172.21.15.57:0/197891474 >> v1:172.21.15.57:6789/0 conn(0x7fa09810bb90 legacy=0x7fa0981a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09484e700 1 -- 172.21.15.57:0/197891474 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43471222 0 0) 0x7fa090001490 con 0x7fa09810bb90 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa095850700 1 -- 172.21.15.57:0/197891474 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0981a93d0 con 0x7fa0980f5a10 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09504f700 1 --2- 172.21.15.57:0/197891474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa09810b740 0x7fa09819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa095850700 1 --2- 172.21.15.57:0/197891474 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980f5a10 0x7fa09810b110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa09810f920 tx=0x7fa08800dc30).ready entity=mon.2 client_cookie=ec0dcb4e4b0972d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:29.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09484e700 1 -- 172.21.15.57:0/197891474 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0981a93d0 con 0x7fa0980f5a10 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09484e700 1 -- 172.21.15.57:0/197891474 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08800bc20 con 0x7fa0980f5a10 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.544 7fa09484e700 1 -- 172.21.15.57:0/197891474 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa088015070 con 0x7fa0980f5a10 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.545 7fa09cc4d700 1 -- 172.21.15.57:0/197891474 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980f5a10 msgr2=0x7fa09810b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.545 7fa09cc4d700 1 --2- 172.21.15.57:0/197891474 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980f5a10 0x7fa09810b110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa09810f920 tx=0x7fa08800dc30).stop 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.545 7fa09cc4d700 1 -- 172.21.15.57:0/197891474 shutdown_connections 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.545 7fa09cc4d700 1 --2- 172.21.15.57:0/197891474 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980f5a10 0x7fa09810b110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.545 7fa09cc4d700 1 --2- 172.21.15.57:0/197891474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa09810b740 0x7fa09819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.545 7fa09cc4d700 1 -- 172.21.15.57:0/197891474 >> 172.21.15.57:0/197891474 conn(0x7fa098113a70 msgr2=0x7fa0980f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.545 7fa09cc4d700 1 -- 172.21.15.57:0/197891474 shutdown_connections 2024-04-25T02:06:29.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.545 7fa09cc4d700 1 -- 172.21.15.57:0/197891474 wait complete. 2024-04-25T02:06:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.569 7fa09cc4d700 1 Processor -- start 2024-04-25T02:06:29.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.569 7fa09cc4d700 1 -- start start 2024-04-25T02:06:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.569 7fa09cc4d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980dd170 0x7fa0981aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.569 7fa09cc4d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981aadb0 0x7fa0981b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.569 7fa09cc4d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0981ab200 0x7fa0981b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.569 7fa09cc4d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980dc850 con 0x7fa0981aadb0 2024-04-25T02:06:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.569 7fa09cc4d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980dcba0 con 0x7fa0981ab200 2024-04-25T02:06:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.569 7fa09cc4d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0981b5370 con 0x7fa0980dd170 2024-04-25T02:06:29.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980dd170 0x7fa0981aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa09504f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981aadb0 0x7fa0981b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980dd170 0x7fa0981aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48384/0 (socket says 172.21.15.57:48384) 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 -- 172.21.15.57:0/3839323521 learned_addr learned my addr 172.21.15.57:0/3839323521 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa096051700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0981ab200 0x7fa0981b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 -- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0981ab200 msgr2=0x7fa0981b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0981ab200 0x7fa0981b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 -- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981aadb0 msgr2=0x7fa0981b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981aadb0 0x7fa0981b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 -- 172.21.15.57:0/3839323521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0981b55a0 con 0x7fa0980dd170 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa09504f700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981aadb0 0x7fa0981b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa096051700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0981ab200 0x7fa0981b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa095850700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980dd170 0x7fa0981aa780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa0980c42c0 tx=0x7fa0880068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa08effd700 1 -- 172.21.15.57:0/3839323521 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0981b55a0 con 0x7fa0980dd170 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa08effd700 1 -- 172.21.15.57:0/3839323521 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08801a440 con 0x7fa0980dd170 2024-04-25T02:06:29.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0981bbe80 con 0x7fa0980dd170 2024-04-25T02:06:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa08effd700 1 -- 172.21.15.57:0/3839323521 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa08801a810 con 0x7fa0980dd170 2024-04-25T02:06:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.570 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0981bc260 con 0x7fa0980dd170 2024-04-25T02:06:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.571 7fa08effd700 1 -- 172.21.15.57:0/3839323521 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa08801aa10 con 0x7fa0980dd170 2024-04-25T02:06:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.571 7fa08effd700 1 -- 172.21.15.57:0/3839323521 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2374+0+0 (secure 0 0 0) 0x7fa088015070 con 0x7fa0980dd170 2024-04-25T02:06:29.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.572 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0980f08e0 con 0x7fa0980dd170 2024-04-25T02:06:29.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.575 7fa08effd700 1 -- 172.21.15.57:0/3839323521 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa08800b820 con 0x7fa0980dd170 2024-04-25T02:06:29.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:29.687 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64} v 0) v1 -- 0x7fa0980e2430 con 0x7fa0980dd170 2024-04-25T02:06:30.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.257 7fa08effd700 1 -- 172.21.15.57:0/3839323521 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 134+0+0 (secure 0 0 0) 0x7fa088010b80 con 0x7fa0980dd170 2024-04-25T02:06:30.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.260 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 >> v1:172.21.15.57:6816/43033 conn(0x7fa07c0145b0 legacy=0x7fa07c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.260 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980dd170 msgr2=0x7fa0981aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.260 7fa09cc4d700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980dd170 0x7fa0981aa780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa0980c42c0 tx=0x7fa0880068c0).stop 2024-04-25T02:06:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.260 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 shutdown_connections 2024-04-25T02:06:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.260 7fa09cc4d700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0981ab200 0x7fa0981b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.260 7fa09cc4d700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0980dd170 0x7fa0981aa780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.260 7fa09cc4d700 1 --2- 172.21.15.57:0/3839323521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0981aadb0 0x7fa0981b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:30.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.260 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 >> 172.21.15.57:0/3839323521 conn(0x7fa0980c55d0 msgr2=0x7fa0980ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:30.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.262 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 shutdown_connections 2024-04-25T02:06:30.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.262 7fa09cc4d700 1 -- 172.21.15.57:0/3839323521 wait complete. 2024-04-25T02:06:30.276 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2024-04-25T02:06:30.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 64 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb456ec6700 1 Processor -- start 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb456ec6700 1 -- start start 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb456ec6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4500f5910 0x7fb4500f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb456ec6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4500f2300 0x7fb45010eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb456ec6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4500f9220 con 0x7fb4500f1eb0 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb456ec6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45010f0d0 con 0x7fb4500f2300 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb456ec6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4501ac670 con 0x7fb4500f5910 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb44f7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4500f5910 0x7fb4500f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb44f7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4500f5910 0x7fb4500f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48386/0 (socket says 172.21.15.57:48386) 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb44ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4500f2300 0x7fb45010eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:30.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.419 7fb44f7fe700 1 -- 172.21.15.57:0/2423338907 learned_addr learned my addr 172.21.15.57:0/2423338907 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb44f7fe700 1 -- 172.21.15.57:0/2423338907 >> v2:172.21.15.57:3300/0 conn(0x7fb4500f2300 msgr2=0x7fb45010eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb44f7fe700 1 --2- 172.21.15.57:0/2423338907 >> v2:172.21.15.57:3300/0 conn(0x7fb4500f2300 0x7fb45010eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb44f7fe700 1 -- 172.21.15.57:0/2423338907 >> v1:172.21.15.57:6789/0 conn(0x7fb4500f1eb0 legacy=0x7fb45010e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb44f7fe700 1 -- 172.21.15.57:0/2423338907 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4501ac820 con 0x7fb4500f5910 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb44f7fe700 1 --2- 172.21.15.57:0/2423338907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4500f5910 0x7fb4500f1880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb440002f70 tx=0x7fb4400099d0).ready entity=mon.2 client_cookie=85084ee634c8d47c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb44e7fc700 1 -- 172.21.15.57:0/2423338907 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4501ac820 con 0x7fb4500f5910 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb44e7fc700 1 -- 172.21.15.57:0/2423338907 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44000f510 con 0x7fb4500f5910 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb44e7fc700 1 -- 172.21.15.57:0/2423338907 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb44000f6f0 con 0x7fb4500f5910 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb456ec6700 1 -- 172.21.15.57:0/2423338907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4500f5910 msgr2=0x7fb4500f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.420 7fb456ec6700 1 --2- 172.21.15.57:0/2423338907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4500f5910 0x7fb4500f1880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb440002f70 tx=0x7fb4400099d0).stop 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.421 7fb456ec6700 1 -- 172.21.15.57:0/2423338907 shutdown_connections 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.421 7fb456ec6700 1 --2- 172.21.15.57:0/2423338907 >> v2:172.21.15.57:3300/0 conn(0x7fb4500f2300 0x7fb45010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.421 7fb456ec6700 1 --2- 172.21.15.57:0/2423338907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4500f5910 0x7fb4500f1880 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.421 7fb456ec6700 1 -- 172.21.15.57:0/2423338907 >> 172.21.15.57:0/2423338907 conn(0x7fb450113a60 msgr2=0x7fb4500f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.421 7fb456ec6700 1 -- 172.21.15.57:0/2423338907 shutdown_connections 2024-04-25T02:06:30.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.421 7fb456ec6700 1 -- 172.21.15.57:0/2423338907 wait complete. 2024-04-25T02:06:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.444 7fb456ec6700 1 Processor -- start 2024-04-25T02:06:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb456ec6700 1 -- start start 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb456ec6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4500d3e10 0x7fb4500d4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb456ec6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500d4890 0x7fb4501b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb456ec6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4501b5350 0x7fb4501b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb456ec6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500bcdc0 con 0x7fb4500d4890 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb456ec6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4501b5dd0 con 0x7fb4500d3e10 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb456ec6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500c8190 con 0x7fb4501b5350 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb44ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4501b5350 0x7fb4501b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb44effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500d4890 0x7fb4501b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb44f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4500d3e10 0x7fb4500d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb44ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4501b5350 0x7fb4501b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48388/0 (socket says 172.21.15.57:48388) 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.445 7fb44ffff700 1 -- 172.21.15.57:0/119059599 learned_addr learned my addr 172.21.15.57:0/119059599 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44effd700 1 -- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4501b5350 msgr2=0x7fb4501b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44effd700 1 --2- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4501b5350 0x7fb4501b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44effd700 1 -- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4500d3e10 msgr2=0x7fb4500d4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44effd700 1 --2- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4500d3e10 0x7fb4500d4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44effd700 1 -- 172.21.15.57:0/119059599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500f01f0 con 0x7fb4500d4890 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44f7fe700 1 --2- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4500d3e10 0x7fb4500d4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44effd700 1 --2- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500d4890 0x7fb4501b4d20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fb4500e15d0 tx=0x7fb44400c7e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:30.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44cff9700 1 -- 172.21.15.57:0/119059599 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb4500f01f0 con 0x7fb4500d4890 2024-04-25T02:06:30.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44cff9700 1 -- 172.21.15.57:0/119059599 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb444007030 con 0x7fb4500d4890 2024-04-25T02:06:30.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb456ec6700 1 -- 172.21.15.57:0/119059599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4500d4ce0 con 0x7fb4500d4890 2024-04-25T02:06:30.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44cff9700 1 -- 172.21.15.57:0/119059599 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb444006520 con 0x7fb4500d4890 2024-04-25T02:06:30.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb456ec6700 1 -- 172.21.15.57:0/119059599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4500c7b60 con 0x7fb4500d4890 2024-04-25T02:06:30.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.446 7fb44cff9700 1 -- 172.21.15.57:0/119059599 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb44401a020 con 0x7fb4500d4890 2024-04-25T02:06:30.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.447 7fb44cff9700 1 -- 172.21.15.57:0/119059599 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 2728+0+0 (secure 0 0 0) 0x7fb444008b80 con 0x7fb4500d4890 2024-04-25T02:06:30.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.447 7fb456ec6700 1 -- 172.21.15.57:0/119059599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4500f08d0 con 0x7fb4500d4890 2024-04-25T02:06:30.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.450 7fb44cff9700 1 -- 172.21.15.57:0/119059599 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb44400cd50 con 0x7fb4500d4890 2024-04-25T02:06:30.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:30.561 7fb456ec6700 1 -- 172.21.15.57:0/119059599 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7fb4500cfc40 con 0x7fb4500d4890 2024-04-25T02:06:31.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.268 7fb44cff9700 1 -- 172.21.15.57:0/119059599 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pgp_num": 64}]=0 pool 'cephfs_data' created v23) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb444000c30 con 0x7fb4500d4890 2024-04-25T02:06:31.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 -- 172.21.15.57:0/119059599 >> v1:172.21.15.57:6816/43033 conn(0x7fb4300145b0 legacy=0x7fb430016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 -- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500d4890 msgr2=0x7fb4501b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 --2- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500d4890 0x7fb4501b4d20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fb4500e15d0 tx=0x7fb44400c7e0).stop 2024-04-25T02:06:31.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 -- 172.21.15.57:0/119059599 shutdown_connections 2024-04-25T02:06:31.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 --2- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb4501b5350 0x7fb4501b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 --2- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4500d3e10 0x7fb4500d4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 --2- 172.21.15.57:0/119059599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500d4890 0x7fb4501b4d20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 -- 172.21.15.57:0/119059599 >> 172.21.15.57:0/119059599 conn(0x7fb4500dcf30 msgr2=0x7fb4500d9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:31.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 -- 172.21.15.57:0/119059599 shutdown_connections 2024-04-25T02:06:31.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.270 7fb456ec6700 1 -- 172.21.15.57:0/119059599 wait complete. 2024-04-25T02:06:31.284 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2024-04-25T02:06:31.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:06:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.453 7f05d43a7700 1 Processor -- start 2024-04-25T02:06:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.453 7f05d43a7700 1 -- start start 2024-04-25T02:06:31.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d43a7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0f58a0 0x7f05cc10c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d43a7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc10c8f0 0x7f05cc0f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d43a7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc0f2640 con 0x7f05cc10cd40 2024-04-25T02:06:31.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d43a7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0fa210 con 0x7f05cc0f58a0 2024-04-25T02:06:31.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d43a7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0f9540 con 0x7f05cc10c8f0 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d11a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0f58a0 0x7f05cc10c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d19a3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f05cc10cd40 0x7f05cc0f1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55656/0 (socket says 172.21.15.57:55656) 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d11a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0f58a0 0x7f05cc10c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60802/0 (socket says 172.21.15.57:60802) 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d19a3700 1 -- 172.21.15.57:0/2201598303 learned_addr learned my addr 172.21.15.57:0/2201598303 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d09a1700 1 --2- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc10c8f0 0x7f05cc0f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05bbfff700 1 -- 172.21.15.57:0/2201598303 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373779989 0 0) 0x7f05c4001490 con 0x7f05cc10cd40 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d09a1700 1 -- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0f58a0 msgr2=0x7f05cc10c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d09a1700 1 --2- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0f58a0 0x7f05cc10c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d09a1700 1 -- 172.21.15.57:0/2201598303 >> v1:172.21.15.57:6789/0 conn(0x7f05cc10cd40 legacy=0x7f05cc0f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d09a1700 1 -- 172.21.15.57:0/2201598303 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc1aa560 con 0x7f05cc10c8f0 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d11a2700 1 --2- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0f58a0 0x7f05cc10c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d09a1700 1 --2- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc10c8f0 0x7f05cc0f1810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f05bc002f70 tx=0x7f05bc00b9a0).ready entity=mon.2 client_cookie=61a5438a4b56d04b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05bbfff700 1 -- 172.21.15.57:0/2201598303 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05cc1aa560 con 0x7f05cc10c8f0 2024-04-25T02:06:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05bbfff700 1 -- 172.21.15.57:0/2201598303 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00d570 con 0x7f05cc10c8f0 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05bbfff700 1 -- 172.21.15.57:0/2201598303 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05bc00d940 con 0x7f05cc10c8f0 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d43a7700 1 -- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc10c8f0 msgr2=0x7f05cc0f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.454 7f05d43a7700 1 --2- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc10c8f0 0x7f05cc0f1810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f05bc002f70 tx=0x7f05bc00b9a0).stop 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.455 7f05d43a7700 1 -- 172.21.15.57:0/2201598303 shutdown_connections 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.455 7f05d43a7700 1 --2- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0f58a0 0x7f05cc10c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.455 7f05d43a7700 1 --2- 172.21.15.57:0/2201598303 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc10c8f0 0x7f05cc0f1810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.455 7f05d43a7700 1 -- 172.21.15.57:0/2201598303 >> 172.21.15.57:0/2201598303 conn(0x7f05cc1139f0 msgr2=0x7f05cc0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.455 7f05d43a7700 1 -- 172.21.15.57:0/2201598303 shutdown_connections 2024-04-25T02:06:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.455 7f05d43a7700 1 -- 172.21.15.57:0/2201598303 wait complete. 2024-04-25T02:06:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.479 7f05d43a7700 1 Processor -- start 2024-04-25T02:06:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.479 7f05d43a7700 1 -- start start 2024-04-25T02:06:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d43a7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0ce350 0x7f05cc0d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d43a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05cc0d66f0 0x7f05cc1b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d43a7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc0d6b40 0x7f05cc1b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d43a7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0c4680 con 0x7f05cc0d66f0 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d43a7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc0ce7a0 con 0x7f05cc0ce350 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d43a7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc1b2d00 con 0x7f05cc0d6b40 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d11a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0ce350 0x7f05cc0d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d19a3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc0d6b40 0x7f05cc1b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d09a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05cc0d66f0 0x7f05cc1b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d11a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0ce350 0x7f05cc0d60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60804/0 (socket says 172.21.15.57:60804) 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d11a2700 1 -- 172.21.15.57:0/1703203927 learned_addr learned my addr 172.21.15.57:0/1703203927 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d19a3700 1 -- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0ce350 msgr2=0x7f05cc0d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d19a3700 1 --2- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0ce350 0x7f05cc0d60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d19a3700 1 -- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05cc0d66f0 msgr2=0x7f05cc1b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d19a3700 1 --2- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05cc0d66f0 0x7f05cc1b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d19a3700 1 -- 172.21.15.57:0/1703203927 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc1b2f30 con 0x7f05cc0d6b40 2024-04-25T02:06:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d11a2700 1 --2- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0ce350 0x7f05cc0d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.480 7f05d19a3700 1 --2- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc0d6b40 0x7f05cc1b26d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f05c4000f40 tx=0x7f05c400c900).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.481 7f05ba7fc700 1 -- 172.21.15.57:0/1703203927 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05cc1b2f30 con 0x7f05cc0d6b40 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.481 7f05ba7fc700 1 -- 172.21.15.57:0/1703203927 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4005bb0 con 0x7f05cc0d6b40 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.481 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc0f6310 con 0x7f05cc0d6b40 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.481 7f05ba7fc700 1 -- 172.21.15.57:0/1703203927 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f05c40070d0 con 0x7f05cc0d6b40 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.481 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc0f6860 con 0x7f05cc0d6b40 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.481 7f05ba7fc700 1 -- 172.21.15.57:0/1703203927 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f05c40072d0 con 0x7f05cc0d6b40 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.481 7f05ba7fc700 1 -- 172.21.15.57:0/1703203927 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3078+0+0 (secure 0 0 0) 0x7f05c4010970 con 0x7f05cc0d6b40 2024-04-25T02:06:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.482 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc0cded0 con 0x7f05cc0d6b40 2024-04-25T02:06:31.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.485 7f05ba7fc700 1 -- 172.21.15.57:0/1703203927 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f05c40059a0 con 0x7f05cc0d6b40 2024-04-25T02:06:31.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.630 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f05cc0f0860 con 0x7f05cc0d6b40 2024-04-25T02:06:31.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.639 7f05ba7fc700 1 -- 172.21.15.57:0/1703203927 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v9) v1 ==== 172+0+0 (secure 0 0 0) 0x7f05cc114570 con 0x7f05cc0d6b40 2024-04-25T02:06:31.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.647 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 >> v1:172.21.15.57:6816/43033 conn(0x7f05ac014540 legacy=0x7f05ac016a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.647 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc0d6b40 msgr2=0x7f05cc1b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.647 7f05d43a7700 1 --2- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc0d6b40 0x7f05cc1b26d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f05c4000f40 tx=0x7f05c400c900).stop 2024-04-25T02:06:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.649 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 shutdown_connections 2024-04-25T02:06:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.649 7f05d43a7700 1 --2- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f05cc0d6b40 0x7f05cc1b26d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.649 7f05d43a7700 1 --2- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f05cc0ce350 0x7f05cc0d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.649 7f05d43a7700 1 --2- 172.21.15.57:0/1703203927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05cc0d66f0 0x7f05cc1b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.649 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 >> 172.21.15.57:0/1703203927 conn(0x7f05cc0c9e70 msgr2=0x7f05cc0ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:31.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.650 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 shutdown_connections 2024-04-25T02:06:31.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.650 7f05d43a7700 1 -- 172.21.15.57:0/1703203927 wait complete. 2024-04-25T02:06:31.667 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T02:06:31.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:31.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc72ea700 1 Processor -- start 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc72ea700 1 -- start start 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc72ea700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febc00f5a10 0x7febc010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc72ea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc010bb90 0x7febc01a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc72ea700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc01a0a70 con 0x7febc010b740 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc72ea700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00fa590 con 0x7febc00f5a10 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc72ea700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc01a0c90 con 0x7febc010bb90 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc48e6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc010bb90 0x7febc01a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc48e6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc010bb90 0x7febc01a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60808/0 (socket says 172.21.15.57:60808) 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febc48e6700 1 -- 172.21.15.57:0/1882236055 learned_addr learned my addr 172.21.15.57:0/1882236055 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febbf7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7febc010b740 0x7febc019fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55662/0 (socket says 172.21.15.57:55662) 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febbffff700 1 --2- 172.21.15.57:0/1882236055 >> v2:172.21.15.57:3300/0 conn(0x7febc00f5a10 0x7febc010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febbffff700 1 -- 172.21.15.57:0/1882236055 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc010bb90 msgr2=0x7febc01a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febbffff700 1 --2- 172.21.15.57:0/1882236055 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc010bb90 0x7febc01a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febbffff700 1 -- 172.21.15.57:0/1882236055 >> v1:172.21.15.57:6789/0 conn(0x7febc010b740 legacy=0x7febc019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febbeffd700 1 -- 172.21.15.57:0/1882236055 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905091553 0 0) 0x7feba8001110 con 0x7febc010b740 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.808 7febbffff700 1 -- 172.21.15.57:0/1882236055 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc01a93d0 con 0x7febc00f5a10 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc48e6700 1 --2- 172.21.15.57:0/1882236055 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc010bb90 0x7febc01a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febbffff700 1 --2- 172.21.15.57:0/1882236055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc00f5a10 0x7febc010b110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7febc0103a10 tx=0x7febb000ba20).ready entity=mon.0 client_cookie=9bac888549be3251 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febbeffd700 1 -- 172.21.15.57:0/1882236055 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7febc01a93d0 con 0x7febc00f5a10 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febbeffd700 1 -- 172.21.15.57:0/1882236055 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb000d5c0 con 0x7febc00f5a10 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febbeffd700 1 -- 172.21.15.57:0/1882236055 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7febb000d990 con 0x7febc00f5a10 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc72ea700 1 -- 172.21.15.57:0/1882236055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc00f5a10 msgr2=0x7febc010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc72ea700 1 --2- 172.21.15.57:0/1882236055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc00f5a10 0x7febc010b110 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7febc0103a10 tx=0x7febb000ba20).stop 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc72ea700 1 -- 172.21.15.57:0/1882236055 shutdown_connections 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc72ea700 1 --2- 172.21.15.57:0/1882236055 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc010bb90 0x7febc01a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc72ea700 1 --2- 172.21.15.57:0/1882236055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc00f5a10 0x7febc010b110 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc72ea700 1 -- 172.21.15.57:0/1882236055 >> 172.21.15.57:0/1882236055 conn(0x7febc0113a70 msgr2=0x7febc00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:31.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc72ea700 1 -- 172.21.15.57:0/1882236055 shutdown_connections 2024-04-25T02:06:31.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.809 7febc72ea700 1 -- 172.21.15.57:0/1882236055 wait complete. 2024-04-25T02:06:31.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.833 7febc72ea700 1 Processor -- start 2024-04-25T02:06:31.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.833 7febc72ea700 1 -- start start 2024-04-25T02:06:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febc72ea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc01ae0a0 0x7febc01ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febc72ea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc01aeb20 0x7febc01a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febc72ea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7febc01a1800 0x7febc01bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febc72ea700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01a2ac0 con 0x7febc01aeb20 2024-04-25T02:06:31.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febc72ea700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00ccd20 con 0x7febc01ae0a0 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febc72ea700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febc00cc6d0 con 0x7febc01a1800 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc01ae0a0 0x7febc01ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc01aeb20 0x7febc01a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc01aeb20 0x7febc01a11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56954/0 (socket says 172.21.15.57:56954) 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc01ae0a0 0x7febc01ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60812/0 (socket says 172.21.15.57:60812) 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 -- 172.21.15.57:0/969166791 learned_addr learned my addr 172.21.15.57:0/969166791 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febc48e6700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7febc01a1800 0x7febc01bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 -- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7febc01a1800 msgr2=0x7febc01bc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7febc01a1800 0x7febc01bc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 -- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc01ae0a0 msgr2=0x7febc01ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc01ae0a0 0x7febc01ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 -- 172.21.15.57:0/969166791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00cc1c0 con 0x7febc01aeb20 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febc48e6700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7febc01a1800 0x7febc01bc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:31.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbffff700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc01ae0a0 0x7febc01ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbf7fe700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc01aeb20 0x7febc01a11d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7febc00c6930 tx=0x7feba800c860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.834 7febbd7fa700 1 -- 172.21.15.57:0/969166791 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7febc00cc1c0 con 0x7febc01aeb20 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.835 7febbd7fa700 1 -- 172.21.15.57:0/969166791 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba80072e0 con 0x7febc01aeb20 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.835 7febc72ea700 1 -- 172.21.15.57:0/969166791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc01a1c50 con 0x7febc01aeb20 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.835 7febbd7fa700 1 -- 172.21.15.57:0/969166791 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feba8005750 con 0x7febc01aeb20 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.835 7febc72ea700 1 -- 172.21.15.57:0/969166791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc01bc8d0 con 0x7febc01aeb20 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.835 7febbd7fa700 1 -- 172.21.15.57:0/969166791 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7feba8005950 con 0x7febc01aeb20 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.835 7febbd7fa700 1 -- 172.21.15.57:0/969166791 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3194+0+0 (secure 0 0 0) 0x7feba8014b20 con 0x7febc01aeb20 2024-04-25T02:06:31.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.836 7febc72ea700 1 -- 172.21.15.57:0/969166791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc00f08e0 con 0x7febc01aeb20 2024-04-25T02:06:31.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.839 7febbd7fa700 1 -- 172.21.15.57:0/969166791 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7feba80070d0 con 0x7febc01aeb20 2024-04-25T02:06:31.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.952 7febc72ea700 1 -- 172.21.15.57:0/969166791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febc00e2430 con 0x7febc01aeb20 2024-04-25T02:06:31.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.952 7febbd7fa700 1 -- 172.21.15.57:0/969166791 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+8745 (secure 0 0 0) 0x7feba8000c30 con 0x7febc01aeb20 2024-04-25T02:06:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:31.959 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:31.632105","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:06:29.733676","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25 02:06:30.607285","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 -- 172.21.15.57:0/969166791 >> v1:172.21.15.57:6816/43033 conn(0x7feba40145b0 legacy=0x7feba4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 -- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc01aeb20 msgr2=0x7febc01a11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc01aeb20 0x7febc01a11d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7febc00c6930 tx=0x7feba800c860).stop 2024-04-25T02:06:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 -- 172.21.15.57:0/969166791 shutdown_connections 2024-04-25T02:06:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7febc01a1800 0x7febc01bc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febc01ae0a0 0x7febc01ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 --2- 172.21.15.57:0/969166791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febc01aeb20 0x7febc01a11d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 -- 172.21.15.57:0/969166791 >> 172.21.15.57:0/969166791 conn(0x7febc00c5b50 msgr2=0x7febc01a5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 -- 172.21.15.57:0/969166791 shutdown_connections 2024-04-25T02:06:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:31.954 7febc72ea700 1 -- 172.21.15.57:0/969166791 wait complete. 2024-04-25T02:06:31.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.096 7f42401bf700 1 Processor -- start 2024-04-25T02:06:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.096 7f42401bf700 1 -- start start 2024-04-25T02:06:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42401bf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380f5920 0x7f42380f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42401bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42380f2310 0x7f423810eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42401bf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42380f9230 con 0x7f42380f1ec0 2024-04-25T02:06:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42401bf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423810f0e0 con 0x7f42380f5920 2024-04-25T02:06:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42401bf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42381ac680 con 0x7f42380f2310 2024-04-25T02:06:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423cfba700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380f5920 0x7f42380f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423d7bb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42380f2310 0x7f423810eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423cfba700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380f5920 0x7f42380f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60816/0 (socket says 172.21.15.57:60816) 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f4237fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f42380f1ec0 0x7f423810e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55678/0 (socket says 172.21.15.57:55678) 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423cfba700 1 -- 172.21.15.57:0/526826722 learned_addr learned my addr 172.21.15.57:0/526826722 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42377fe700 1 -- 172.21.15.57:0/526826722 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287447420 0 0) 0x7f4220001110 con 0x7f42380f1ec0 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423d7bb700 1 -- 172.21.15.57:0/526826722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380f5920 msgr2=0x7f42380f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423d7bb700 1 --2- 172.21.15.57:0/526826722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380f5920 0x7f42380f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423d7bb700 1 -- 172.21.15.57:0/526826722 >> v1:172.21.15.57:6789/0 conn(0x7f42380f1ec0 legacy=0x7f423810e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423d7bb700 1 -- 172.21.15.57:0/526826722 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42381ac830 con 0x7f42380f2310 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f423d7bb700 1 --2- 172.21.15.57:0/526826722 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42380f2310 0x7f423810eab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f42300032f0 tx=0x7f4230009cc0).ready entity=mon.2 client_cookie=6773447fe360ff5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42377fe700 1 -- 172.21.15.57:0/526826722 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42381ac830 con 0x7f42380f2310 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42377fe700 1 -- 172.21.15.57:0/526826722 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423000b880 con 0x7f42380f2310 2024-04-25T02:06:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42377fe700 1 -- 172.21.15.57:0/526826722 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f423000ba60 con 0x7f42380f2310 2024-04-25T02:06:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42401bf700 1 -- 172.21.15.57:0/526826722 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42380f2310 msgr2=0x7f423810eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.097 7f42401bf700 1 --2- 172.21.15.57:0/526826722 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42380f2310 0x7f423810eab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f42300032f0 tx=0x7f4230009cc0).stop 2024-04-25T02:06:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.098 7f42401bf700 1 -- 172.21.15.57:0/526826722 shutdown_connections 2024-04-25T02:06:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.098 7f42401bf700 1 --2- 172.21.15.57:0/526826722 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42380f2310 0x7f423810eab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.098 7f42401bf700 1 --2- 172.21.15.57:0/526826722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380f5920 0x7f42380f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.098 7f42401bf700 1 -- 172.21.15.57:0/526826722 >> 172.21.15.57:0/526826722 conn(0x7f4238113a70 msgr2=0x7f42380f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.098 7f42401bf700 1 -- 172.21.15.57:0/526826722 shutdown_connections 2024-04-25T02:06:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.098 7f42401bf700 1 -- 172.21.15.57:0/526826722 wait complete. 2024-04-25T02:06:32.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.122 7f42401bf700 1 Processor -- start 2024-04-25T02:06:32.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.122 7f42401bf700 1 -- start start 2024-04-25T02:06:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f42401bf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380d81a0 0x7f42381b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f42401bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42381b1eb0 0x7f42381b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f42401bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42381b2300 0x7f42381b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f42401bf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380d8730 con 0x7f42381b2300 2024-04-25T02:06:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f42401bf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42380bc940 con 0x7f42380d81a0 2024-04-25T02:06:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f42401bf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42381b55e0 con 0x7f42381b1eb0 2024-04-25T02:06:32.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f423cfba700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380d81a0 0x7f42381b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f423cfba700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380d81a0 0x7f42381b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60822/0 (socket says 172.21.15.57:60822) 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f4237fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42381b1eb0 0x7f42381b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f423cfba700 1 -- 172.21.15.57:0/1752577627 learned_addr learned my addr 172.21.15.57:0/1752577627 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.123 7f423d7bb700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42381b2300 0x7f42381b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4237fff700 1 -- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380d81a0 msgr2=0x7f42381b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4237fff700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380d81a0 0x7f42381b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4237fff700 1 -- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42381b2300 msgr2=0x7f42381b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4237fff700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42381b2300 0x7f42381b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4237fff700 1 -- 172.21.15.57:0/1752577627 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42381b5810 con 0x7f42381b1eb0 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f423cfba700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380d81a0 0x7f42381b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f423d7bb700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42381b2300 0x7f42381b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4237fff700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42381b1eb0 0x7f42381b4980 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f42380bdbd0 tx=0x7f422000c750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:32.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4235ffb700 1 -- 172.21.15.57:0/1752577627 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f42381b5810 con 0x7f42381b1eb0 2024-04-25T02:06:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4235ffb700 1 -- 172.21.15.57:0/1752577627 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42200070d0 con 0x7f42381b1eb0 2024-04-25T02:06:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f42401bf700 1 -- 172.21.15.57:0/1752577627 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42381bc120 con 0x7f42381b1eb0 2024-04-25T02:06:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4235ffb700 1 -- 172.21.15.57:0/1752577627 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4220005560 con 0x7f42381b1eb0 2024-04-25T02:06:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f42401bf700 1 -- 172.21.15.57:0/1752577627 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42381bc500 con 0x7f42381b1eb0 2024-04-25T02:06:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4235ffb700 1 -- 172.21.15.57:0/1752577627 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f4220005970 con 0x7f42381b1eb0 2024-04-25T02:06:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.124 7f4235ffb700 1 -- 172.21.15.57:0/1752577627 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f4220014800 con 0x7f42381b1eb0 2024-04-25T02:06:32.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.125 7f42401bf700 1 -- 172.21.15.57:0/1752577627 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42380f08e0 con 0x7f42381b1eb0 2024-04-25T02:06:32.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.128 7f4235ffb700 1 -- 172.21.15.57:0/1752577627 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f4220005760 con 0x7f42381b1eb0 2024-04-25T02:06:32.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.238 7f42401bf700 1 -- 172.21.15.57:0/1752577627 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42380cf370 con 0x7f42381b1eb0 2024-04-25T02:06:32.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.238 7f4235ffb700 1 -- 172.21.15.57:0/1752577627 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+8745 (secure 0 0 0) 0x7f4220000c30 con 0x7f42381b1eb0 2024-04-25T02:06:32.245 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:32.245 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:31.632105","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:06:29.733676","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25 02:06:30.607285","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.239 7f42401bf700 1 -- 172.21.15.57:0/1752577627 >> v1:172.21.15.57:6816/43033 conn(0x7f421c0145b0 legacy=0x7f421c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.239 7f42401bf700 1 -- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42381b1eb0 msgr2=0x7f42381b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.240 7f42401bf700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42381b1eb0 0x7f42381b4980 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f42380bdbd0 tx=0x7f422000c750).stop 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.240 7f42401bf700 1 -- 172.21.15.57:0/1752577627 shutdown_connections 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.240 7f42401bf700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42381b2300 0x7f42381b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.240 7f42401bf700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42380d81a0 0x7f42381b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.240 7f42401bf700 1 --2- 172.21.15.57:0/1752577627 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f42381b1eb0 0x7f42381b4980 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.240 7f42401bf700 1 -- 172.21.15.57:0/1752577627 >> 172.21.15.57:0/1752577627 conn(0x7f42380dcab0 msgr2=0x7f42380d8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.240 7f42401bf700 1 -- 172.21.15.57:0/1752577627 shutdown_connections 2024-04-25T02:06:32.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.240 7f42401bf700 1 -- 172.21.15.57:0/1752577627 wait complete. 2024-04-25T02:06:32.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:06:32.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.386 7fb90c237700 1 Processor -- start 2024-04-25T02:06:32.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.386 7fb90c237700 1 -- start start 2024-04-25T02:06:32.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb90c237700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040f58a0 0x7fb9040f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb90c237700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040f1e40 0x7fb90410e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb90c237700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9040f91b0 con 0x7fb9040f2290 2024-04-25T02:06:32.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb90c237700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90410f060 con 0x7fb9040f58a0 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb90c237700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9041ac600 con 0x7fb9040f1e40 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb909032700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040f58a0 0x7fb9040f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb908831700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040f1e40 0x7fb90410e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb909032700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040f58a0 0x7fb9040f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60836/0 (socket says 172.21.15.57:60836) 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb908831700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040f1e40 0x7fb90410e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48444/0 (socket says 172.21.15.57:48444) 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb909032700 1 -- 172.21.15.57:0/2887179118 learned_addr learned my addr 172.21.15.57:0/2887179118 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb909032700 1 -- 172.21.15.57:0/2887179118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040f1e40 msgr2=0x7fb90410e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb909032700 1 --2- 172.21.15.57:0/2887179118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040f1e40 0x7fb90410e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb909032700 1 -- 172.21.15.57:0/2887179118 >> v1:172.21.15.57:6789/0 conn(0x7fb9040f2290 legacy=0x7fb90410e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb909032700 1 -- 172.21.15.57:0/2887179118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9041ac7b0 con 0x7fb9040f58a0 2024-04-25T02:06:32.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb8f3fff700 1 -- 172.21.15.57:0/2887179118 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987023978 0 0) 0x7fb8fc001490 con 0x7fb9040f2290 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.387 7fb908831700 1 --2- 172.21.15.57:0/2887179118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040f1e40 0x7fb90410e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb909032700 1 --2- 172.21.15.57:0/2887179118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040f58a0 0x7fb9040f1810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb900002f70 tx=0x7fb900009a80).ready entity=mon.1 client_cookie=c9c9117db815a63f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb8f3fff700 1 -- 172.21.15.57:0/2887179118 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9041ac7b0 con 0x7fb9040f58a0 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb8f3fff700 1 -- 172.21.15.57:0/2887179118 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90000f510 con 0x7fb9040f58a0 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb8f3fff700 1 -- 172.21.15.57:0/2887179118 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb90000f6f0 con 0x7fb9040f58a0 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb90c237700 1 -- 172.21.15.57:0/2887179118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040f58a0 msgr2=0x7fb9040f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb90c237700 1 --2- 172.21.15.57:0/2887179118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040f58a0 0x7fb9040f1810 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb900002f70 tx=0x7fb900009a80).stop 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb90c237700 1 -- 172.21.15.57:0/2887179118 shutdown_connections 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb90c237700 1 --2- 172.21.15.57:0/2887179118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040f58a0 0x7fb9040f1810 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb90c237700 1 --2- 172.21.15.57:0/2887179118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040f1e40 0x7fb90410e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb90c237700 1 -- 172.21.15.57:0/2887179118 >> 172.21.15.57:0/2887179118 conn(0x7fb9041139f0 msgr2=0x7fb9040f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb90c237700 1 -- 172.21.15.57:0/2887179118 shutdown_connections 2024-04-25T02:06:32.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.388 7fb90c237700 1 -- 172.21.15.57:0/2887179118 wait complete. 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.412 7fb90c237700 1 Processor -- start 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.412 7fb90c237700 1 -- start start 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb90c237700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040ba8b0 0x7fb9040bad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb90c237700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040bb330 0x7fb9041b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb90c237700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9041b0e20 0x7fb9041bb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb90c237700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040dce20 con 0x7fb9041b0e20 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb90c237700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040c72e0 con 0x7fb9040ba8b0 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb90c237700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040dcad0 con 0x7fb9040bb330 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040ba8b0 0x7fb9040bad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb908831700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040bb330 0x7fb9041b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909833700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9041b0e20 0x7fb9041bb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040ba8b0 0x7fb9040bad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60840/0 (socket says 172.21.15.57:60840) 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 -- 172.21.15.57:0/2533925943 learned_addr learned my addr 172.21.15.57:0/2533925943 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb908831700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040bb330 0x7fb9041b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48460/0 (socket says 172.21.15.57:48460) 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909833700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9041b0e20 0x7fb9041bb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56964/0 (socket says 172.21.15.57:56964) 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 -- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040bb330 msgr2=0x7fb9041b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040bb330 0x7fb9041b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 -- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9041b0e20 msgr2=0x7fb9041bb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9041b0e20 0x7fb9041bb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 -- 172.21.15.57:0/2533925943 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9041b1270 con 0x7fb9040ba8b0 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909833700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9041b0e20 0x7fb9041bb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb908831700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040bb330 0x7fb9041b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb909032700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040ba8b0 0x7fb9040bad00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fb9040bc760 tx=0x7fb9000068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:32.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.413 7fb8f27fc700 1 -- 172.21.15.57:0/2533925943 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9041b1270 con 0x7fb9040ba8b0 2024-04-25T02:06:32.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.414 7fb8f27fc700 1 -- 172.21.15.57:0/2533925943 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb900011970 con 0x7fb9040ba8b0 2024-04-25T02:06:32.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.414 7fb90c237700 1 -- 172.21.15.57:0/2533925943 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9041b1530 con 0x7fb9040ba8b0 2024-04-25T02:06:32.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.414 7fb8f27fc700 1 -- 172.21.15.57:0/2533925943 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb900011d80 con 0x7fb9040ba8b0 2024-04-25T02:06:32.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.414 7fb90c237700 1 -- 172.21.15.57:0/2533925943 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9041bbb10 con 0x7fb9040ba8b0 2024-04-25T02:06:32.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.414 7fb8f27fc700 1 -- 172.21.15.57:0/2533925943 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb900019030 con 0x7fb9040ba8b0 2024-04-25T02:06:32.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.414 7fb8f27fc700 1 -- 172.21.15.57:0/2533925943 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fb900018040 con 0x7fb9040ba8b0 2024-04-25T02:06:32.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.415 7fb90c237700 1 -- 172.21.15.57:0/2533925943 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9040f0860 con 0x7fb9040ba8b0 2024-04-25T02:06:32.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.418 7fb8f27fc700 1 -- 172.21.15.57:0/2533925943 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb90000f300 con 0x7fb9040ba8b0 2024-04-25T02:06:32.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.562 7fb90c237700 1 -- 172.21.15.57:0/2533925943 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb9040de560 con 0x7fb9040ba8b0 2024-04-25T02:06:32.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.650 7fb8f27fc700 1 -- 172.21.15.57:0/2533925943 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb900011760 con 0x7fb9040ba8b0 2024-04-25T02:06:32.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 -- 172.21.15.57:0/2533925943 >> v1:172.21.15.57:6816/43033 conn(0x7fb8e40145b0 legacy=0x7fb8e4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 -- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040ba8b0 msgr2=0x7fb9040bad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040ba8b0 0x7fb9040bad00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fb9040bc760 tx=0x7fb9000068c0).stop 2024-04-25T02:06:32.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 -- 172.21.15.57:0/2533925943 shutdown_connections 2024-04-25T02:06:32.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9041b0e20 0x7fb9041bb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9040ba8b0 0x7fb9040bad00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 --2- 172.21.15.57:0/2533925943 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb9040bb330 0x7fb9041b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 -- 172.21.15.57:0/2533925943 >> 172.21.15.57:0/2533925943 conn(0x7fb9040bce60 msgr2=0x7fb9040bf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:32.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 -- 172.21.15.57:0/2533925943 shutdown_connections 2024-04-25T02:06:32.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.651 7fb90c237700 1 -- 172.21.15.57:0/2533925943 wait complete. 2024-04-25T02:06:32.669 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T02:06:32.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:06:32.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc51b4c3700 1 Processor -- start 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc51b4c3700 1 -- start start 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc51b4c3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5140f5a10 0x7fc51410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc51b4c3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc51410b740 0x7fc51419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc51b4c3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5141a0a70 con 0x7fc51410bb90 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc51b4c3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140fa590 con 0x7fc51410b740 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc51b4c3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5141a0c90 con 0x7fc5140f5a10 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc5137fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc51410b740 0x7fc51419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc513fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5140f5a10 0x7fc51410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc518abf700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc51410bb90 0x7fc5141a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55698/0 (socket says 172.21.15.57:55698) 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.799 7fc518abf700 1 -- 172.21.15.57:0/4263145679 learned_addr learned my addr 172.21.15.57:0/4263145679 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc5137fe700 1 -- 172.21.15.57:0/4263145679 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5140f5a10 msgr2=0x7fc51410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc5137fe700 1 --2- 172.21.15.57:0/4263145679 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5140f5a10 0x7fc51410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc5137fe700 1 -- 172.21.15.57:0/4263145679 >> v1:172.21.15.57:6789/0 conn(0x7fc51410bb90 legacy=0x7fc5141a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc512ffd700 1 -- 172.21.15.57:0/4263145679 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513127762 0 0) 0x7fc50c001490 con 0x7fc51410bb90 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc5137fe700 1 -- 172.21.15.57:0/4263145679 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5141a93d0 con 0x7fc51410b740 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc513fff700 1 --2- 172.21.15.57:0/4263145679 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5140f5a10 0x7fc51410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc5137fe700 1 --2- 172.21.15.57:0/4263145679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc51410b740 0x7fc51419fc40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fc508002f70 tx=0x7fc50800b9f0).ready entity=mon.0 client_cookie=491b763eaf737b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc512ffd700 1 -- 172.21.15.57:0/4263145679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5141a93d0 con 0x7fc51410b740 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc512ffd700 1 -- 172.21.15.57:0/4263145679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50800d5c0 con 0x7fc51410b740 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc512ffd700 1 -- 172.21.15.57:0/4263145679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc50800d990 con 0x7fc51410b740 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc51b4c3700 1 -- 172.21.15.57:0/4263145679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc51410b740 msgr2=0x7fc51419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc51b4c3700 1 --2- 172.21.15.57:0/4263145679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc51410b740 0x7fc51419fc40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fc508002f70 tx=0x7fc50800b9f0).stop 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc51b4c3700 1 -- 172.21.15.57:0/4263145679 shutdown_connections 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc51b4c3700 1 --2- 172.21.15.57:0/4263145679 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5140f5a10 0x7fc51410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc51b4c3700 1 --2- 172.21.15.57:0/4263145679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc51410b740 0x7fc51419fc40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc51b4c3700 1 -- 172.21.15.57:0/4263145679 >> 172.21.15.57:0/4263145679 conn(0x7fc514113a70 msgr2=0x7fc5140f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.800 7fc51b4c3700 1 -- 172.21.15.57:0/4263145679 shutdown_connections 2024-04-25T02:06:32.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.801 7fc51b4c3700 1 -- 172.21.15.57:0/4263145679 wait complete. 2024-04-25T02:06:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.824 7fc51b4c3700 1 Processor -- start 2024-04-25T02:06:32.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.824 7fc51b4c3700 1 -- start start 2024-04-25T02:06:32.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc51b4c3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5141b2850 0x7fc5141b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc51b4c3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5141b32d0 0x7fc5140d9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc51b4c3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5140d9d50 0x7fc5141b9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc51b4c3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140d94f0 con 0x7fc5141b2850 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc51b4c3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140ce700 con 0x7fc5140d9d50 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc51b4c3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140ce260 con 0x7fc5141b32d0 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc513fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5141b2850 0x7fc5141b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc513fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5141b2850 0x7fc5141b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56982/0 (socket says 172.21.15.57:56982) 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc513fff700 1 -- 172.21.15.57:0/2696108914 learned_addr learned my addr 172.21.15.57:0/2696108914 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc518abf700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5140d9d50 0x7fc5141b9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc5137fe700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5141b32d0 0x7fc5140d9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc513fff700 1 -- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5141b32d0 msgr2=0x7fc5140d9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc513fff700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5141b32d0 0x7fc5140d9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc513fff700 1 -- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5140d9d50 msgr2=0x7fc5141b9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc513fff700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5140d9d50 0x7fc5141b9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.825 7fc513fff700 1 -- 172.21.15.57:0/2696108914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140bb720 con 0x7fc5141b2850 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.826 7fc513fff700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5141b2850 0x7fc5141b2ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fc5140cdd20 tx=0x7fc50400bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.826 7fc5117fa700 1 -- 172.21.15.57:0/2696108914 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc50400f040 con 0x7fc5141b2850 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.826 7fc5117fa700 1 -- 172.21.15.57:0/2696108914 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50400c9a0 con 0x7fc5141b2850 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.826 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5140dede0 con 0x7fc5141b2850 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.826 7fc5117fa700 1 -- 172.21.15.57:0/2696108914 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc50400cd70 con 0x7fc5141b2850 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.826 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5140c90d0 con 0x7fc5141b2850 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.826 7fc5117fa700 1 -- 172.21.15.57:0/2696108914 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc504011070 con 0x7fc5141b2850 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.826 7fc5117fa700 1 -- 172.21.15.57:0/2696108914 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc504010040 con 0x7fc5141b2850 2024-04-25T02:06:32.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.827 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5140f08e0 con 0x7fc5141b2850 2024-04-25T02:06:32.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.830 7fc5117fa700 1 -- 172.21.15.57:0/2696108914 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc50400c5a0 con 0x7fc5141b2850 2024-04-25T02:06:32.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:32.973 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc5140a85b0 con 0x7fc5141b2850 2024-04-25T02:06:33.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.685 7fc5117fa700 1 -- 172.21.15.57:0/2696108914 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc504000c30 con 0x7fc5141b2850 2024-04-25T02:06:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 >> v1:172.21.15.57:6816/43033 conn(0x7fc4f40145b0 legacy=0x7fc4f4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5141b2850 msgr2=0x7fc5141b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5141b2850 0x7fc5141b2ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fc5140cdd20 tx=0x7fc50400bf70).stop 2024-04-25T02:06:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 shutdown_connections 2024-04-25T02:06:33.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5140d9d50 0x7fc5141b9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5141b2850 0x7fc5141b2ca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 --2- 172.21.15.57:0/2696108914 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5141b32d0 0x7fc5140d9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 >> 172.21.15.57:0/2696108914 conn(0x7fc5140bc750 msgr2=0x7fc5140be120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 shutdown_connections 2024-04-25T02:06:33.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.687 7fc51b4c3700 1 -- 172.21.15.57:0/2696108914 wait complete. 2024-04-25T02:06:33.709 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:06:33.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:33.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.843 7fc2ea8b1700 1 Processor -- start 2024-04-25T02:06:33.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.843 7fc2ea8b1700 1 -- start start 2024-04-25T02:06:33.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2ea8b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc2e410c780 0x7fc2e410cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:33.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2ea8b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e40f1970 0x7fc2e40f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:33.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2ea8b1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40f3a20 con 0x7fc2e40f23f0 2024-04-25T02:06:33.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2ea8b1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40fa1f0 con 0x7fc2e410c780 2024-04-25T02:06:33.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2ea8b1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40f95a0 con 0x7fc2e40f1970 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e2dea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e40f1970 0x7fc2e40f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e35eb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc2e410c780 0x7fc2e410cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e3dec700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc2e40f23f0 0x7fc2e41a82b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55706/0 (socket says 172.21.15.57:55706) 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e3dec700 1 -- 172.21.15.57:0/3091416660 learned_addr learned my addr 172.21.15.57:0/3091416660 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e35eb700 1 -- 172.21.15.57:0/3091416660 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e40f1970 msgr2=0x7fc2e40f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e35eb700 1 --2- 172.21.15.57:0/3091416660 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e40f1970 0x7fc2e40f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e35eb700 1 -- 172.21.15.57:0/3091416660 >> v1:172.21.15.57:6789/0 conn(0x7fc2e40f23f0 legacy=0x7fc2e41a82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e35eb700 1 -- 172.21.15.57:0/3091416660 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4110ca0 con 0x7fc2e410c780 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e25e9700 1 -- 172.21.15.57:0/3091416660 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569242790 0 0) 0x7fc2dc001490 con 0x7fc2e40f23f0 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e2dea700 1 --2- 172.21.15.57:0/3091416660 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e40f1970 0x7fc2e40f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.844 7fc2e35eb700 1 --2- 172.21.15.57:0/3091416660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e410c780 0x7fc2e410cbd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fc2e40f4880 tx=0x7fc2d400ba20).ready entity=mon.0 client_cookie=1ef1ebcebd99b9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2e25e9700 1 -- 172.21.15.57:0/3091416660 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2d400d5c0 con 0x7fc2e410c780 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2e25e9700 1 -- 172.21.15.57:0/3091416660 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d400d7c0 con 0x7fc2e410c780 2024-04-25T02:06:33.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2e25e9700 1 -- 172.21.15.57:0/3091416660 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2d400db90 con 0x7fc2e410c780 2024-04-25T02:06:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2ea8b1700 1 -- 172.21.15.57:0/3091416660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e410c780 msgr2=0x7fc2e410cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2ea8b1700 1 --2- 172.21.15.57:0/3091416660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e410c780 0x7fc2e410cbd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fc2e40f4880 tx=0x7fc2d400ba20).stop 2024-04-25T02:06:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2ea8b1700 1 -- 172.21.15.57:0/3091416660 shutdown_connections 2024-04-25T02:06:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2ea8b1700 1 --2- 172.21.15.57:0/3091416660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e410c780 0x7fc2e410cbd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2ea8b1700 1 --2- 172.21.15.57:0/3091416660 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e40f1970 0x7fc2e40f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2ea8b1700 1 -- 172.21.15.57:0/3091416660 >> 172.21.15.57:0/3091416660 conn(0x7fc2e4113a80 msgr2=0x7fc2e40f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2ea8b1700 1 -- 172.21.15.57:0/3091416660 shutdown_connections 2024-04-25T02:06:33.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.845 7fc2ea8b1700 1 -- 172.21.15.57:0/3091416660 wait complete. 2024-04-25T02:06:33.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.869 7fc2ea8b1700 1 Processor -- start 2024-04-25T02:06:33.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.869 7fc2ea8b1700 1 -- start start 2024-04-25T02:06:33.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.869 7fc2ea8b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e41af560 0x7fc2e41af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:33.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2ea8b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2e41affe0 0x7fc2e40dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:33.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2ea8b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e40dc1e0 0x7fc2e40dc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:33.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2ea8b1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40f04d0 con 0x7fc2e40dc1e0 2024-04-25T02:06:33.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2ea8b1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40c5060 con 0x7fc2e41affe0 2024-04-25T02:06:33.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2ea8b1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40e0fa0 con 0x7fc2e41af560 2024-04-25T02:06:33.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e41af560 0x7fc2e41af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:33.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e3dec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e40dc1e0 0x7fc2e40dc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e2dea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2e41affe0 0x7fc2e40dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e41af560 0x7fc2e41af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48484/0 (socket says 172.21.15.57:48484) 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 -- 172.21.15.57:0/1996874708 learned_addr learned my addr 172.21.15.57:0/1996874708 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 -- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2e41affe0 msgr2=0x7fc2e40dbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2e41affe0 0x7fc2e40dbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 -- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e40dc1e0 msgr2=0x7fc2e40dc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e40dc1e0 0x7fc2e40dc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 -- 172.21.15.57:0/1996874708 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40c4bf0 con 0x7fc2e41af560 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e2dea700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2e41affe0 0x7fc2e40dbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e3dec700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e40dc1e0 0x7fc2e40dc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e35eb700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e41af560 0x7fc2e41af9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc2e40dea90 tx=0x7fc2d40068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e0de6700 1 -- 172.21.15.57:0/1996874708 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2e40c4bf0 con 0x7fc2e41af560 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e0de6700 1 -- 172.21.15.57:0/1996874708 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d4011980 con 0x7fc2e41af560 2024-04-25T02:06:33.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2e0de6700 1 -- 172.21.15.57:0/1996874708 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2d4017040 con 0x7fc2e41af560 2024-04-25T02:06:33.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e40d7c50 con 0x7fc2e41af560 2024-04-25T02:06:33.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.870 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e41ba050 con 0x7fc2e41af560 2024-04-25T02:06:33.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.871 7fc2e0de6700 1 -- 172.21.15.57:0/1996874708 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc2d4026360 con 0x7fc2e41af560 2024-04-25T02:06:33.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.871 7fc2e0de6700 1 -- 172.21.15.57:0/1996874708 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc2d4018070 con 0x7fc2e41af560 2024-04-25T02:06:33.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.871 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e40d0190 con 0x7fc2e41af560 2024-04-25T02:06:33.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:33.875 7fc2e0de6700 1 -- 172.21.15.57:0/1996874708 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc2d4011770 con 0x7fc2e41af560 2024-04-25T02:06:34.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.016 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2e40e1440 con 0x7fc2e41af560 2024-04-25T02:06:34.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.017 7fc2e0de6700 1 -- 172.21.15.57:0/1996874708 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1700 (secure 0 0 0) 0x7fc2d400d3b0 con 0x7fc2e41af560 2024-04-25T02:06:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:34.024 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:06:31.632273","modified":"2024-04-25 02:06:33.665250","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4684":{"gid":4684,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6817/32905363","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":32905363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 >> v1:172.21.15.57:6816/43033 conn(0x7fc2c80145b0 legacy=0x7fc2c8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e41af560 msgr2=0x7fc2e41af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e41af560 0x7fc2e41af9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc2e40dea90 tx=0x7fc2d40068c0).stop 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 shutdown_connections 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2e40dc1e0 0x7fc2e40dc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc2e41af560 0x7fc2e41af9b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 --2- 172.21.15.57:0/1996874708 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2e41affe0 0x7fc2e40dbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 >> 172.21.15.57:0/1996874708 conn(0x7fc2e41a2800 msgr2=0x7fc2e40c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 shutdown_connections 2024-04-25T02:06:34.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.018 7fc2ea8b1700 1 -- 172.21.15.57:0/1996874708 wait complete. 2024-04-25T02:06:34.026 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 11 2024-04-25T02:06:34.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:34.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49cef09700 1 Processor -- start 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49cef09700 1 -- start start 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49cef09700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49c80f2090 0x7f49c81a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49cef09700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c81a8c80 0x7f49c81ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49cef09700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c80f9230 con 0x7f49c80f5920 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49cef09700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c80f24e0 con 0x7f49c80f2090 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49cef09700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49c81ac720 con 0x7f49c81a8c80 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49c6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49c80f2090 0x7f49c81a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49c7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c81a8c80 0x7f49c81ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49c77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f49c80f5920 0x7f49c80f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55712/0 (socket says 172.21.15.57:55712) 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49c6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49c80f2090 0x7f49c81a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57014/0 (socket says 172.21.15.57:57014) 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49c77fe700 1 -- 172.21.15.57:0/2558111032 learned_addr learned my addr 172.21.15.57:0/2558111032 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:34.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49c7fff700 1 -- 172.21.15.57:0/2558111032 >> v2:172.21.15.57:3300/0 conn(0x7f49c80f2090 msgr2=0x7f49c81a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.161 7f49c7fff700 1 --2- 172.21.15.57:0/2558111032 >> v2:172.21.15.57:3300/0 conn(0x7f49c80f2090 0x7f49c81a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49c7fff700 1 -- 172.21.15.57:0/2558111032 >> v1:172.21.15.57:6789/0 conn(0x7f49c80f5920 legacy=0x7f49c80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49c67fc700 1 -- 172.21.15.57:0/2558111032 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207469794 0 0) 0x7f49b8001110 con 0x7f49c80f5920 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49c7fff700 1 -- 172.21.15.57:0/2558111032 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c81ac8d0 con 0x7f49c81a8c80 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49c6ffd700 1 --2- 172.21.15.57:0/2558111032 >> v2:172.21.15.57:3300/0 conn(0x7f49c80f2090 0x7f49c81a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49c7fff700 1 --2- 172.21.15.57:0/2558111032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c81a8c80 0x7f49c81ab0e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f49c00032f0 tx=0x7f49c0009c90).ready entity=mon.2 client_cookie=8b1ab020ddda26c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49c67fc700 1 -- 172.21.15.57:0/2558111032 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49c81ac8d0 con 0x7f49c81a8c80 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49c67fc700 1 -- 172.21.15.57:0/2558111032 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c000b880 con 0x7f49c81a8c80 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49c67fc700 1 -- 172.21.15.57:0/2558111032 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49c000ba60 con 0x7f49c81a8c80 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49cef09700 1 -- 172.21.15.57:0/2558111032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c81a8c80 msgr2=0x7f49c81ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49cef09700 1 --2- 172.21.15.57:0/2558111032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c81a8c80 0x7f49c81ab0e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f49c00032f0 tx=0x7f49c0009c90).stop 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49cef09700 1 -- 172.21.15.57:0/2558111032 shutdown_connections 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49cef09700 1 --2- 172.21.15.57:0/2558111032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c81a8c80 0x7f49c81ab0e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49cef09700 1 --2- 172.21.15.57:0/2558111032 >> v2:172.21.15.57:3300/0 conn(0x7f49c80f2090 0x7f49c81a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.162 7f49cef09700 1 -- 172.21.15.57:0/2558111032 >> 172.21.15.57:0/2558111032 conn(0x7f49c8113a70 msgr2=0x7f49c80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.163 7f49cef09700 1 -- 172.21.15.57:0/2558111032 shutdown_connections 2024-04-25T02:06:34.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.163 7f49cef09700 1 -- 172.21.15.57:0/2558111032 wait complete. 2024-04-25T02:06:34.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.186 7f49cef09700 1 Processor -- start 2024-04-25T02:06:34.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49cef09700 1 -- start start 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49cef09700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49c81b4950 0x7f49c81b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49cef09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49c81b53d0 0x7f49c80c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49cef09700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c80c69a0 0x7f49c80c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49cef09700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80c75b0 con 0x7f49c81b53d0 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49cef09700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c81bbe30 con 0x7f49c81b4950 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49cef09700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49c81bbfe0 con 0x7f49c80c69a0 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49c77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49c81b4950 0x7f49c81b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49c6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49c81b53d0 0x7f49c80c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49c77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49c81b4950 0x7f49c81b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60870/0 (socket says 172.21.15.57:60870) 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49c6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49c81b53d0 0x7f49c80c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57028/0 (socket says 172.21.15.57:57028) 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49c77fe700 1 -- 172.21.15.57:0/2123809218 learned_addr learned my addr 172.21.15.57:0/2123809218 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:34.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.187 7f49c7fff700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c80c69a0 0x7f49c80c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c77fe700 1 -- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c80c69a0 msgr2=0x7f49c80c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c77fe700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c80c69a0 0x7f49c80c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c77fe700 1 -- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49c81b53d0 msgr2=0x7f49c80c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c77fe700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49c81b53d0 0x7f49c80c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c77fe700 1 -- 172.21.15.57:0/2123809218 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c81bc190 con 0x7f49c81b4950 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c6ffd700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49c81b53d0 0x7f49c80c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c77fe700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49c81b4950 0x7f49c81b4da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f49c80dd030 tx=0x7f49b800c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c4ff9700 1 -- 172.21.15.57:0/2123809218 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49c81bc190 con 0x7f49c81b4950 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c4ff9700 1 -- 172.21.15.57:0/2123809218 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b80072e0 con 0x7f49c81b4950 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49cef09700 1 -- 172.21.15.57:0/2123809218 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c81bc390 con 0x7f49c81b4950 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c4ff9700 1 -- 172.21.15.57:0/2123809218 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f49b8005810 con 0x7f49c81b4950 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49cef09700 1 -- 172.21.15.57:0/2123809218 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c81bc770 con 0x7f49c81b4950 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.188 7f49c4ff9700 1 -- 172.21.15.57:0/2123809218 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f49b8005a10 con 0x7f49c81b4950 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.189 7f49c4ff9700 1 -- 172.21.15.57:0/2123809218 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f49b8014a90 con 0x7f49c81b4950 2024-04-25T02:06:34.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.189 7f49cef09700 1 -- 172.21.15.57:0/2123809218 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c80f08e0 con 0x7f49c81b4950 2024-04-25T02:06:34.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.192 7f49c4ff9700 1 -- 172.21.15.57:0/2123809218 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f49b80070d0 con 0x7f49c81b4950 2024-04-25T02:06:34.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.304 7f49cef09700 1 -- 172.21.15.57:0/2123809218 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c80f22c0 con 0x7f49c81b4950 2024-04-25T02:06:34.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.304 7f49c4ff9700 1 -- 172.21.15.57:0/2123809218 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f49b8000c30 con 0x7f49c81b4950 2024-04-25T02:06:34.311 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:34.311 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:32.635396","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:06:29.733676","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25 02:06:30.607285","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:34.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.305 7f49cef09700 1 -- 172.21.15.57:0/2123809218 >> v1:172.21.15.57:6816/43033 conn(0x7f49ac0145b0 legacy=0x7f49ac016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.305 7f49cef09700 1 -- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49c81b4950 msgr2=0x7f49c81b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.305 7f49cef09700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49c81b4950 0x7f49c81b4da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f49c80dd030 tx=0x7f49b800c860).stop 2024-04-25T02:06:34.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.305 7f49cef09700 1 -- 172.21.15.57:0/2123809218 shutdown_connections 2024-04-25T02:06:34.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.305 7f49cef09700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49c80c69a0 0x7f49c80c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.305 7f49cef09700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49c81b4950 0x7f49c81b4da0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.305 7f49cef09700 1 --2- 172.21.15.57:0/2123809218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49c81b53d0 0x7f49c80c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.305 7f49cef09700 1 -- 172.21.15.57:0/2123809218 >> 172.21.15.57:0/2123809218 conn(0x7f49c80dca10 msgr2=0x7f49c80c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.306 7f49cef09700 1 -- 172.21.15.57:0/2123809218 shutdown_connections 2024-04-25T02:06:34.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.306 7f49cef09700 1 -- 172.21.15.57:0/2123809218 wait complete. 2024-04-25T02:06:34.323 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:06:34.324 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc504de1700 1 Processor -- start 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc504de1700 1 -- start start 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc504de1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc50010b910 0x7fc5001a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc504de1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5001a59d0 0x7fc5001a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc504de1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50010bd60 con 0x7fc5000f5a10 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc504de1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5000fa590 con 0x7fc50010b910 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc504de1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5001a0c50 con 0x7fc5001a59d0 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc4fd363700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc50010b910 0x7fc5001a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc4fdb64700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc5000f5a10 0x7fc50010b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55722/0 (socket says 172.21.15.57:55722) 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc4fdb64700 1 -- 172.21.15.57:0/1139130734 learned_addr learned my addr 172.21.15.57:0/1139130734 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.448 7fc4fe365700 1 --2- 172.21.15.57:0/1139130734 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5001a59d0 0x7fc5001a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fe365700 1 -- 172.21.15.57:0/1139130734 >> v2:172.21.15.57:3300/0 conn(0x7fc50010b910 msgr2=0x7fc5001a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fe365700 1 --2- 172.21.15.57:0/1139130734 >> v2:172.21.15.57:3300/0 conn(0x7fc50010b910 0x7fc5001a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fe365700 1 -- 172.21.15.57:0/1139130734 >> v1:172.21.15.57:6789/0 conn(0x7fc5000f5a10 legacy=0x7fc50010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fe365700 1 -- 172.21.15.57:0/1139130734 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5001a9470 con 0x7fc5001a59d0 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fcb62700 1 -- 172.21.15.57:0/1139130734 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066554167 0 0) 0x7fc4f0001110 con 0x7fc5000f5a10 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fd363700 1 --2- 172.21.15.57:0/1139130734 >> v2:172.21.15.57:3300/0 conn(0x7fc50010b910 0x7fc5001a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fe365700 1 --2- 172.21.15.57:0/1139130734 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5001a59d0 0x7fc5001a7e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc5000f47c0 tx=0x7fc4f8009cc0).ready entity=mon.2 client_cookie=7e546c8d37f5933b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fcb62700 1 -- 172.21.15.57:0/1139130734 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5001a9470 con 0x7fc5001a59d0 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fcb62700 1 -- 172.21.15.57:0/1139130734 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f800b840 con 0x7fc5001a59d0 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc4fcb62700 1 -- 172.21.15.57:0/1139130734 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4f800ba20 con 0x7fc5001a59d0 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc504de1700 1 -- 172.21.15.57:0/1139130734 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5001a59d0 msgr2=0x7fc5001a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.449 7fc504de1700 1 --2- 172.21.15.57:0/1139130734 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5001a59d0 0x7fc5001a7e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc5000f47c0 tx=0x7fc4f8009cc0).stop 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.450 7fc504de1700 1 -- 172.21.15.57:0/1139130734 shutdown_connections 2024-04-25T02:06:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.450 7fc504de1700 1 --2- 172.21.15.57:0/1139130734 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5001a59d0 0x7fc5001a7e30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.450 7fc504de1700 1 --2- 172.21.15.57:0/1139130734 >> v2:172.21.15.57:3300/0 conn(0x7fc50010b910 0x7fc5001a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.450 7fc504de1700 1 -- 172.21.15.57:0/1139130734 >> 172.21.15.57:0/1139130734 conn(0x7fc500113a70 msgr2=0x7fc5000f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.450 7fc504de1700 1 -- 172.21.15.57:0/1139130734 shutdown_connections 2024-04-25T02:06:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.450 7fc504de1700 1 -- 172.21.15.57:0/1139130734 wait complete. 2024-04-25T02:06:34.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc504de1700 1 Processor -- start 2024-04-25T02:06:34.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc504de1700 1 -- start start 2024-04-25T02:06:34.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc504de1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5000f1890 0x7fc5001ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc504de1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5001ae080 0x7fc5000d4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc504de1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5001ae4d0 0x7fc5000d4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc504de1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000e6530 con 0x7fc5001ae4d0 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc504de1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000f2590 con 0x7fc5001ae080 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc504de1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000f1f40 con 0x7fc5000f1890 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc4fd363700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5001ae080 0x7fc5000d4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc4fe365700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5001ae4d0 0x7fc5000d4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc4fdb64700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5000f1890 0x7fc5001ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc4fd363700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5001ae080 0x7fc5000d4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60874/0 (socket says 172.21.15.57:60874) 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc4fd363700 1 -- 172.21.15.57:0/1616416879 learned_addr learned my addr 172.21.15.57:0/1616416879 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.474 7fc4fe365700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5001ae4d0 0x7fc5000d4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57054/0 (socket says 172.21.15.57:57054) 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4fd363700 1 -- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5000f1890 msgr2=0x7fc5001ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4fd363700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5000f1890 0x7fc5001ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4fd363700 1 -- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5001ae4d0 msgr2=0x7fc5000d4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4fd363700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5001ae4d0 0x7fc5000d4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4fd363700 1 -- 172.21.15.57:0/1616416879 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5000d5370 con 0x7fc5001ae080 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4fe365700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5001ae4d0 0x7fc5000d4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4fdb64700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5000f1890 0x7fc5001ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4fd363700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5001ae080 0x7fc5000d4710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc5000e15a0 tx=0x7fc4e800ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4f6ffd700 1 -- 172.21.15.57:0/1616416879 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc5000d5370 con 0x7fc5001ae080 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4f6ffd700 1 -- 172.21.15.57:0/1616416879 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e800c9a0 con 0x7fc5001ae080 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4f6ffd700 1 -- 172.21.15.57:0/1616416879 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4e800f040 con 0x7fc5001ae080 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc504de1700 1 -- 172.21.15.57:0/1616416879 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5001bbc10 con 0x7fc5001ae080 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc504de1700 1 -- 172.21.15.57:0/1616416879 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5001bbff0 con 0x7fc5001ae080 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4f6ffd700 1 -- 172.21.15.57:0/1616416879 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc4e8011070 con 0x7fc5001ae080 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.475 7fc4f6ffd700 1 -- 172.21.15.57:0/1616416879 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fc4e8010040 con 0x7fc5001ae080 2024-04-25T02:06:34.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.476 7fc504de1700 1 -- 172.21.15.57:0/1616416879 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5000f08e0 con 0x7fc5001ae080 2024-04-25T02:06:34.486 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.479 7fc4f6ffd700 1 -- 172.21.15.57:0/1616416879 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc4e800c5a0 con 0x7fc5001ae080 2024-04-25T02:06:34.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.586 7fc504de1700 1 -- 172.21.15.57:0/1616416879 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fc500087810 con 0x7fc4e40145b0 2024-04-25T02:06:34.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.593 7fc4f6ffd700 1 -- 172.21.15.57:0/1616416879 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299771 (unknown 2965378022 0 2358489110) 0x7fc4f0001580 con 0x7fc4e40145b0 2024-04-25T02:06:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 -- 172.21.15.57:0/1616416879 >> v1:172.21.15.57:6816/43033 conn(0x7fc4e40145b0 legacy=0x7fc4e4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 -- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5001ae080 msgr2=0x7fc5000d4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5001ae080 0x7fc5000d4710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc5000e15a0 tx=0x7fc4e800ecd0).stop 2024-04-25T02:06:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 -- 172.21.15.57:0/1616416879 shutdown_connections 2024-04-25T02:06:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5001ae4d0 0x7fc5000d4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5000f1890 0x7fc5001ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 --2- 172.21.15.57:0/1616416879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5001ae080 0x7fc5000d4710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 -- 172.21.15.57:0/1616416879 >> 172.21.15.57:0/1616416879 conn(0x7fc5000c5910 msgr2=0x7fc5000cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 -- 172.21.15.57:0/1616416879 shutdown_connections 2024-04-25T02:06:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.596 7fc504de1700 1 -- 172.21.15.57:0/1616416879 wait complete. 2024-04-25T02:06:34.607 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:34.614 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-25 02:06:32.675241","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195080,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292280,"statfs":{"total":386547056640,"available":382251294720,"internally_reserved":4294967296,"allocated":753664,"data_stored":220700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3467,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.181982"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"17","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.867813","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:23.867813","last_peered":"2024-04-25 02:06:23.867813","last_clean":"2024-04-25 02:06:23.867813","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:23.867813","last_undegraded":"2024-04-25 02:06:23.867813","last_fullsized":"2024-04-25 02:06:23.867813","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.469159","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:24.469159","last_peered":"2024-04-25 02:06:24.469159","last_clean":"2024-04-25 02:06:24.469159","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:24.469159","last_undegraded":"2024-04-25 02:06:24.469159","last_fullsized":"2024-04-25 02:06:24.469159","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.862226","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:23.862226","last_peered":"2024-04-25 02:06:23.862226","last_clean":"2024-04-25 02:06:23.862226","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:23.862226","last_undegraded":"2024-04-25 02:06:23.862226","last_fullsized":"2024-04-25 02:06:23.862226","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.868573","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:23.868573","last_peered":"2024-04-25 02:06:23.868573","last_clean":"2024-04-25 02:06:23.868573","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:23.868573","last_undegraded":"2024-04-25 02:06:23.868573","last_fullsized":"2024-04-25 02:06:23.868573","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.865261","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:23.865261","last_peered":"2024-04-25 02:06:23.865261","last_clean":"2024-04-25 02:06:23.865261","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:23.865261","last_undegraded":"2024-04-25 02:06:23.865261","last_fullsized":"2024-04-25 02:06:23.865261","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.468610","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:24.468610","last_peered":"2024-04-25 02:06:24.468610","last_clean":"2024-04-25 02:06:24.468610","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:24.468610","last_undegraded":"2024-04-25 02:06:24.468610","last_fullsized":"2024-04-25 02:06:24.468610","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.471668","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:24.471668","last_peered":"2024-04-25 02:06:24.471668","last_clean":"2024-04-25 02:06:24.471668","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:24.471668","last_undegraded":"2024-04-25 02:06:24.471668","last_fullsized":"2024-04-25 02:06:24.471668","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.863819","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:23.863819","last_peered":"2024-04-25 02:06:23.863819","last_clean":"2024-04-25 02:06:23.863819","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:23.863819","last_undegraded":"2024-04-25 02:06:23.863819","last_fullsized":"2024-04-25 02:06:23.863819","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]}]}]}} 2024-04-25T02:06:34.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:34.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa82b124700 1 Processor -- start 2024-04-25T02:06:34.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa82b124700 1 -- start start 2024-04-25T02:06:34.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa82b124700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240f5920 0x7fa8240f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa82b124700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8240f1ec0 0x7fa82410e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa82b124700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8240f9230 con 0x7fa8240f2310 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa82b124700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82410f0e0 con 0x7fa8240f1ec0 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa82b124700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8241ac680 con 0x7fa8240f5920 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa8237fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240f5920 0x7fa8240f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa8237fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240f5920 0x7fa8240f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60884/0 (socket says 172.21.15.57:60884) 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa822ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8240f1ec0 0x7fa82410e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa8237fe700 1 -- 172.21.15.57:0/4260321782 learned_addr learned my addr 172.21.15.57:0/4260321782 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa823fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa8240f2310 0x7fa82410e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55724/0 (socket says 172.21.15.57:55724) 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa822ffd700 1 -- 172.21.15.57:0/4260321782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240f5920 msgr2=0x7fa8240f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa822ffd700 1 --2- 172.21.15.57:0/4260321782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240f5920 0x7fa8240f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa822ffd700 1 -- 172.21.15.57:0/4260321782 >> v1:172.21.15.57:6789/0 conn(0x7fa8240f2310 legacy=0x7fa82410e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa822ffd700 1 -- 172.21.15.57:0/4260321782 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8241ac830 con 0x7fa8240f1ec0 2024-04-25T02:06:34.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.781 7fa8227fc700 1 -- 172.21.15.57:0/4260321782 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170774340 0 0) 0x7fa81c001490 con 0x7fa8240f2310 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa8237fe700 1 --2- 172.21.15.57:0/4260321782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240f5920 0x7fa8240f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa822ffd700 1 --2- 172.21.15.57:0/4260321782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8240f1ec0 0x7fa82410e2b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa80c002f70 tx=0x7fa80c00b9f0).ready entity=mon.0 client_cookie=d18da7288f7f72a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa8227fc700 1 -- 172.21.15.57:0/4260321782 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8241ac830 con 0x7fa8240f1ec0 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa8227fc700 1 -- 172.21.15.57:0/4260321782 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00d5c0 con 0x7fa8240f1ec0 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa8227fc700 1 -- 172.21.15.57:0/4260321782 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa80c00d990 con 0x7fa8240f1ec0 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa82b124700 1 -- 172.21.15.57:0/4260321782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8240f1ec0 msgr2=0x7fa82410e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa82b124700 1 --2- 172.21.15.57:0/4260321782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8240f1ec0 0x7fa82410e2b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa80c002f70 tx=0x7fa80c00b9f0).stop 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa82b124700 1 -- 172.21.15.57:0/4260321782 shutdown_connections 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa82b124700 1 --2- 172.21.15.57:0/4260321782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240f5920 0x7fa8240f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa82b124700 1 --2- 172.21.15.57:0/4260321782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8240f1ec0 0x7fa82410e2b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa82b124700 1 -- 172.21.15.57:0/4260321782 >> 172.21.15.57:0/4260321782 conn(0x7fa824113a70 msgr2=0x7fa8240f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa82b124700 1 -- 172.21.15.57:0/4260321782 shutdown_connections 2024-04-25T02:06:34.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.782 7fa82b124700 1 -- 172.21.15.57:0/4260321782 wait complete. 2024-04-25T02:06:34.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.806 7fa82b124700 1 Processor -- start 2024-04-25T02:06:34.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa82b124700 1 -- start start 2024-04-25T02:06:34.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa82b124700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8240d33d0 0x7fa8240d3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa82b124700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240d3e50 0x7fa8241b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa82b124700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8241b3ed0 0x7fa8241bbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:34.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa82b124700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240bca80 con 0x7fa8241b3ed0 2024-04-25T02:06:34.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa82b124700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240d5a30 con 0x7fa8240d3e50 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa82b124700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240d42a0 con 0x7fa8240d33d0 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa8237fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8240d33d0 0x7fa8240d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa822ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240d3e50 0x7fa8241b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa8237fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8240d33d0 0x7fa8240d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48534/0 (socket says 172.21.15.57:48534) 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa8237fe700 1 -- 172.21.15.57:0/3694116021 learned_addr learned my addr 172.21.15.57:0/3694116021 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa823fff700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8241b3ed0 0x7fa8241bbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa822ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240d3e50 0x7fa8241b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60898/0 (socket says 172.21.15.57:60898) 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa8237fe700 1 -- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240d3e50 msgr2=0x7fa8241b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa8237fe700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240d3e50 0x7fa8241b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa8237fe700 1 -- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8241b3ed0 msgr2=0x7fa8241bbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa8237fe700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8241b3ed0 0x7fa8241bbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa8237fe700 1 -- 172.21.15.57:0/3694116021 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240d8690 con 0x7fa8240d33d0 2024-04-25T02:06:34.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.807 7fa823fff700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8241b3ed0 0x7fa8241bbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.808 7fa8237fe700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8240d33d0 0x7fa8240d3820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa8240c56e0 tx=0x7fa81400ecb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.808 7fa820ff9700 1 -- 172.21.15.57:0/3694116021 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8240d8690 con 0x7fa8240d33d0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.808 7fa820ff9700 1 -- 172.21.15.57:0/3694116021 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400c620 con 0x7fa8240d33d0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.808 7fa820ff9700 1 -- 172.21.15.57:0/3694116021 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa81400f040 con 0x7fa8240d33d0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.808 7fa82b124700 1 -- 172.21.15.57:0/3694116021 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8241b4320 con 0x7fa8240d33d0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.808 7fa82b124700 1 -- 172.21.15.57:0/3694116021 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8241bc5b0 con 0x7fa8240d33d0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.808 7fa820ff9700 1 -- 172.21.15.57:0/3694116021 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa814011070 con 0x7fa8240d33d0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.808 7fa820ff9700 1 -- 172.21.15.57:0/3694116021 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa814010040 con 0x7fa8240d33d0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.809 7fa82b124700 1 -- 172.21.15.57:0/3694116021 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8240f08e0 con 0x7fa8240d33d0 2024-04-25T02:06:34.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.812 7fa820ff9700 1 -- 172.21.15.57:0/3694116021 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa81400edf0 con 0x7fa8240d33d0 2024-04-25T02:06:34.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.919 7fa82b124700 1 -- 172.21.15.57:0/3694116021 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fa8241b5950 con 0x7fa8080145b0 2024-04-25T02:06:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.926 7fa820ff9700 1 -- 172.21.15.57:0/3694116021 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299771 (unknown 2965378022 0 2316892489) 0x7fa8241b5950 con 0x7fa8080145b0 2024-04-25T02:06:34.937 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:34.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 -- 172.21.15.57:0/3694116021 >> v1:172.21.15.57:6816/43033 conn(0x7fa8080145b0 legacy=0x7fa808016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 -- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8240d33d0 msgr2=0x7fa8240d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8240d33d0 0x7fa8240d3820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa8240c56e0 tx=0x7fa81400ecb0).stop 2024-04-25T02:06:34.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 -- 172.21.15.57:0/3694116021 shutdown_connections 2024-04-25T02:06:34.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8241b3ed0 0x7fa8241bbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8240d33d0 0x7fa8240d3820 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 --2- 172.21.15.57:0/3694116021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8240d3e50 0x7fa8241b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:34.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 -- 172.21.15.57:0/3694116021 >> 172.21.15.57:0/3694116021 conn(0x7fa8240e11c0 msgr2=0x7fa8240d8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 -- 172.21.15.57:0/3694116021 shutdown_connections 2024-04-25T02:06:34.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:34.929 7fa82b124700 1 -- 172.21.15.57:0/3694116021 wait complete. 2024-04-25T02:06:34.940 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:34.947 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-25 02:06:34.675627","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195080,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292280,"statfs":{"total":386547056640,"available":382251294720,"internally_reserved":4294967296,"allocated":753664,"data_stored":220700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3467,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.181982"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"17","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.867813","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:23.867813","last_peered":"2024-04-25 02:06:23.867813","last_clean":"2024-04-25 02:06:23.867813","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:23.867813","last_undegraded":"2024-04-25 02:06:23.867813","last_fullsized":"2024-04-25 02:06:23.867813","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.469159","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:24.469159","last_peered":"2024-04-25 02:06:24.469159","last_clean":"2024-04-25 02:06:24.469159","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:24.469159","last_undegraded":"2024-04-25 02:06:24.469159","last_fullsized":"2024-04-25 02:06:24.469159","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.862226","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:23.862226","last_peered":"2024-04-25 02:06:23.862226","last_clean":"2024-04-25 02:06:23.862226","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:23.862226","last_undegraded":"2024-04-25 02:06:23.862226","last_fullsized":"2024-04-25 02:06:23.862226","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.868573","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:23.868573","last_peered":"2024-04-25 02:06:23.868573","last_clean":"2024-04-25 02:06:23.868573","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:23.868573","last_undegraded":"2024-04-25 02:06:23.868573","last_fullsized":"2024-04-25 02:06:23.868573","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.865261","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:23.865261","last_peered":"2024-04-25 02:06:23.865261","last_clean":"2024-04-25 02:06:23.865261","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:23.865261","last_undegraded":"2024-04-25 02:06:23.865261","last_fullsized":"2024-04-25 02:06:23.865261","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.468610","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:24.468610","last_peered":"2024-04-25 02:06:24.468610","last_clean":"2024-04-25 02:06:24.468610","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:24.468610","last_undegraded":"2024-04-25 02:06:24.468610","last_fullsized":"2024-04-25 02:06:24.468610","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.471668","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:24.471668","last_peered":"2024-04-25 02:06:24.471668","last_clean":"2024-04-25 02:06:24.471668","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:24.471668","last_undegraded":"2024-04-25 02:06:24.471668","last_fullsized":"2024-04-25 02:06:24.471668","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.863819","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:23.863819","last_peered":"2024-04-25 02:06:23.863819","last_clean":"2024-04-25 02:06:23.863819","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:23.863819","last_undegraded":"2024-04-25 02:06:23.863819","last_fullsized":"2024-04-25 02:06:23.863819","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]}]}]}} 2024-04-25T02:06:34.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.112 7f4804741700 1 Processor -- start 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.112 7f4804741700 1 -- start start 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f4804741700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0f58a0 0x7f47fc0f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f4804741700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f47fc0f2290 0x7f47fc10ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f4804741700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0f91b0 con 0x7f47fc0f1e40 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f4804741700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc10f060 con 0x7f47fc0f2290 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f4804741700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1ac600 con 0x7f47fc0f58a0 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f480153c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0f58a0 0x7f47fc0f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f480153c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0f58a0 0x7f47fc0f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48536/0 (socket says 172.21.15.57:48536) 2024-04-25T02:06:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f480153c700 1 -- 172.21.15.57:0/1644748885 learned_addr learned my addr 172.21.15.57:0/1644748885 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f4801d3d700 1 --2- 172.21.15.57:0/1644748885 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0f2290 0x7f47fc10ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f47effff700 1 -- 172.21.15.57:0/1644748885 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284795614 0 0) 0x7f47f0001110 con 0x7f47fc0f1e40 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f480153c700 1 -- 172.21.15.57:0/1644748885 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0f2290 msgr2=0x7f47fc10ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f480153c700 1 --2- 172.21.15.57:0/1644748885 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0f2290 0x7f47fc10ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f480153c700 1 -- 172.21.15.57:0/1644748885 >> v1:172.21.15.57:6789/0 conn(0x7f47fc0f1e40 legacy=0x7f47fc10e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f480153c700 1 -- 172.21.15.57:0/1644748885 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc1ac7b0 con 0x7f47fc0f58a0 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.113 7f4801d3d700 1 --2- 172.21.15.57:0/1644748885 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0f2290 0x7f47fc10ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f480153c700 1 --2- 172.21.15.57:0/1644748885 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0f58a0 0x7f47fc0f1810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f47f8002f70 tx=0x7f47f80099d0).ready entity=mon.2 client_cookie=fb287b0650adc46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f47effff700 1 -- 172.21.15.57:0/1644748885 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47fc1ac7b0 con 0x7f47fc0f58a0 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f47effff700 1 -- 172.21.15.57:0/1644748885 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f800f510 con 0x7f47fc0f58a0 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f47effff700 1 -- 172.21.15.57:0/1644748885 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47f800f6f0 con 0x7f47fc0f58a0 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f4804741700 1 -- 172.21.15.57:0/1644748885 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0f58a0 msgr2=0x7f47fc0f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f4804741700 1 --2- 172.21.15.57:0/1644748885 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0f58a0 0x7f47fc0f1810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f47f8002f70 tx=0x7f47f80099d0).stop 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f4804741700 1 -- 172.21.15.57:0/1644748885 shutdown_connections 2024-04-25T02:06:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f4804741700 1 --2- 172.21.15.57:0/1644748885 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0f2290 0x7f47fc10ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f4804741700 1 --2- 172.21.15.57:0/1644748885 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0f58a0 0x7f47fc0f1810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f4804741700 1 -- 172.21.15.57:0/1644748885 >> 172.21.15.57:0/1644748885 conn(0x7f47fc1139f0 msgr2=0x7f47fc0f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:35.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f4804741700 1 -- 172.21.15.57:0/1644748885 shutdown_connections 2024-04-25T02:06:35.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.114 7f4804741700 1 -- 172.21.15.57:0/1644748885 wait complete. 2024-04-25T02:06:35.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.138 7f4804741700 1 Processor -- start 2024-04-25T02:06:35.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.138 7f4804741700 1 -- start start 2024-04-25T02:06:35.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4804741700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c3a10 0x7f47fc0c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4804741700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0c4490 0x7f47fc1b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4804741700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc1b4e60 0x7f47fc1bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4804741700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0e6490 con 0x7f47fc1b4e60 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4804741700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0c3750 con 0x7f47fc0c3a10 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4804741700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0c5850 con 0x7f47fc0c4490 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f480153c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c3a10 0x7f47fc0c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4800d3b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0c4490 0x7f47fc1b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f480153c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c3a10 0x7f47fc0c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60912/0 (socket says 172.21.15.57:60912) 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f480153c700 1 -- 172.21.15.57:0/4109275869 learned_addr learned my addr 172.21.15.57:0/4109275869 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4801d3d700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc1b4e60 0x7f47fc1bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4801d3d700 1 -- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0c4490 msgr2=0x7f47fc1b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4801d3d700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0c4490 0x7f47fc1b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4801d3d700 1 -- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c3a10 msgr2=0x7f47fc0c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4801d3d700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c3a10 0x7f47fc0c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4801d3d700 1 -- 172.21.15.57:0/4109275869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc0c0780 con 0x7f47fc1b4e60 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f480153c700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c3a10 0x7f47fc0c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4800d3b700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0c4490 0x7f47fc1b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4801d3d700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc1b4e60 0x7f47fc1bbc90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f47fc0bc260 tx=0x7f47f400eda0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f47ee7fc700 1 -- 172.21.15.57:0/4109275869 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47fc0c0780 con 0x7f47fc1b4e60 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f47ee7fc700 1 -- 172.21.15.57:0/4109275869 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f400c880 con 0x7f47fc1b4e60 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f4804741700 1 -- 172.21.15.57:0/4109275869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc1b52b0 con 0x7f47fc1b4e60 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.139 7f47ee7fc700 1 -- 172.21.15.57:0/4109275869 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47f400f040 con 0x7f47fc1b4e60 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.140 7f4804741700 1 -- 172.21.15.57:0/4109275869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc1b55d0 con 0x7f47fc1b4e60 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.140 7f47ee7fc700 1 -- 172.21.15.57:0/4109275869 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f47f4022060 con 0x7f47fc1b4e60 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.140 7f47ee7fc700 1 -- 172.21.15.57:0/4109275869 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f47f4010040 con 0x7f47fc1b4e60 2024-04-25T02:06:35.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.141 7f4804741700 1 -- 172.21.15.57:0/4109275869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc0f0860 con 0x7f47fc1b4e60 2024-04-25T02:06:35.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.144 7f47ee7fc700 1 -- 172.21.15.57:0/4109275869 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f47f400c670 con 0x7f47fc1b4e60 2024-04-25T02:06:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.252 7f4804741700 1 -- 172.21.15.57:0/4109275869 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f47fc087810 con 0x7f47e40145b0 2024-04-25T02:06:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.259 7f47ee7fc700 1 -- 172.21.15.57:0/4109275869 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299771 (unknown 2965378022 0 2316892489) 0x7f47f8009df0 con 0x7f47e40145b0 2024-04-25T02:06:35.270 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 -- 172.21.15.57:0/4109275869 >> v1:172.21.15.57:6816/43033 conn(0x7f47e40145b0 legacy=0x7f47e4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 -- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc1b4e60 msgr2=0x7f47fc1bbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc1b4e60 0x7f47fc1bbc90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f47fc0bc260 tx=0x7f47f400eda0).stop 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 -- 172.21.15.57:0/4109275869 shutdown_connections 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc1b4e60 0x7f47fc1bbc90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c3a10 0x7f47fc0c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 --2- 172.21.15.57:0/4109275869 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f47fc0c4490 0x7f47fc1b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 -- 172.21.15.57:0/4109275869 >> 172.21.15.57:0/4109275869 conn(0x7f47fc0bd670 msgr2=0x7f47fc0c1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:35.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 -- 172.21.15.57:0/4109275869 shutdown_connections 2024-04-25T02:06:35.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.262 7f4804741700 1 -- 172.21.15.57:0/4109275869 wait complete. 2024-04-25T02:06:35.274 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:35.280 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-25 02:06:34.675627","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195080,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292280,"statfs":{"total":386547056640,"available":382251294720,"internally_reserved":4294967296,"allocated":753664,"data_stored":220700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3467,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.181982"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"17","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.867813","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:23.867813","last_peered":"2024-04-25 02:06:23.867813","last_clean":"2024-04-25 02:06:23.867813","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:23.867813","last_undegraded":"2024-04-25 02:06:23.867813","last_fullsized":"2024-04-25 02:06:23.867813","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.469159","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:24.469159","last_peered":"2024-04-25 02:06:24.469159","last_clean":"2024-04-25 02:06:24.469159","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:24.469159","last_undegraded":"2024-04-25 02:06:24.469159","last_fullsized":"2024-04-25 02:06:24.469159","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.862226","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:23.862226","last_peered":"2024-04-25 02:06:23.862226","last_clean":"2024-04-25 02:06:23.862226","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:23.862226","last_undegraded":"2024-04-25 02:06:23.862226","last_fullsized":"2024-04-25 02:06:23.862226","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.868573","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:23.868573","last_peered":"2024-04-25 02:06:23.868573","last_clean":"2024-04-25 02:06:23.868573","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:23.868573","last_undegraded":"2024-04-25 02:06:23.868573","last_fullsized":"2024-04-25 02:06:23.868573","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.865261","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:23.865261","last_peered":"2024-04-25 02:06:23.865261","last_clean":"2024-04-25 02:06:23.865261","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:23.865261","last_undegraded":"2024-04-25 02:06:23.865261","last_fullsized":"2024-04-25 02:06:23.865261","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.468610","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:24.468610","last_peered":"2024-04-25 02:06:24.468610","last_clean":"2024-04-25 02:06:24.468610","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:24.468610","last_undegraded":"2024-04-25 02:06:24.468610","last_fullsized":"2024-04-25 02:06:24.468610","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.471668","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:24.471668","last_peered":"2024-04-25 02:06:24.471668","last_clean":"2024-04-25 02:06:24.471668","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:24.471668","last_undegraded":"2024-04-25 02:06:24.471668","last_fullsized":"2024-04-25 02:06:24.471668","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.863819","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:23.863819","last_peered":"2024-04-25 02:06:23.863819","last_clean":"2024-04-25 02:06:23.863819","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:23.863819","last_undegraded":"2024-04-25 02:06:23.863819","last_fullsized":"2024-04-25 02:06:23.863819","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]}]}]}} 2024-04-25T02:06:35.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-25T02:06:35.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-25T02:06:35.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-25T02:06:35.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-25T02:06:35.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-25T02:06:35.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-25T02:06:35.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-25T02:06:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-25T02:06:35.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-25T02:06:35.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-25T02:06:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-25T02:06:35.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-25T02:06:35.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-25T02:06:35.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T02:06:35.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-25T02:06:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T02:06:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-25T02:06:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T02:06:35.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T02:06:35.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-25T02:06:35.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-25T02:06:35.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-25T02:06:35.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T02:06:35.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-25T02:06:35.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-25T02:06:35.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T02:06:35.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-25T02:06:35.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:31.247756', 'last_change': '2024-04-25 02:06:31.247756', 'last_active': '2024-04-25 02:06:31.247756', 'last_peered': '2024-04-25 02:06:31.247756', 'last_clean': '2024-04-25 02:06:31.247756', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:31.247756', 'last_undegraded': '2024-04-25 02:06:31.247756', 'last_fullsized': '2024-04-25 02:06:31.247756', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:31.247756', 'last_clean_scrub_stamp': '2024-04-25 02:06:31.247756', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-25T02:06:35.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': '0', 'reported_epoch': '0', 'state': 'unknown', 'last_fresh': '2024-04-25 02:06:30.241589', 'last_change': '2024-04-25 02:06:30.241589', 'last_active': '2024-04-25 02:06:30.241589', 'last_peered': '2024-04-25 02:06:30.241589', 'last_clean': '2024-04-25 02:06:30.241589', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25 02:06:30.241589', 'last_undegraded': '2024-04-25 02:06:30.241589', 'last_fullsized': '2024-04-25 02:06:30.241589', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25 02:06:30.241589', 'last_clean_scrub_stamp': '2024-04-25 02:06:30.241589', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T02:06:35.311 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:06:35.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.444 7fa85a68a700 1 Processor -- start 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.444 7fa85a68a700 1 -- start start 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.444 7fa85a68a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8540f5a10 0x7fa85410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.444 7fa85a68a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa85410b740 0x7fa85419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa85a68a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8541a0a70 con 0x7fa85410bb90 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa85a68a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8540fa590 con 0x7fa85410b740 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa85a68a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8541a0c90 con 0x7fa8540f5a10 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa84abaf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa85410b740 0x7fa85419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa853bb1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa85410bb90 0x7fa8541a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55734/0 (socket says 172.21.15.57:55734) 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa8533b0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8540f5a10 0x7fa85410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa853bb1700 1 -- 172.21.15.57:0/3517191855 learned_addr learned my addr 172.21.15.57:0/3517191855 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa84abaf700 1 -- 172.21.15.57:0/3517191855 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8540f5a10 msgr2=0x7fa85410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:35.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa84abaf700 1 --2- 172.21.15.57:0/3517191855 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8540f5a10 0x7fa85410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa84abaf700 1 -- 172.21.15.57:0/3517191855 >> v1:172.21.15.57:6789/0 conn(0x7fa85410bb90 legacy=0x7fa8541a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa84abaf700 1 -- 172.21.15.57:0/3517191855 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8541a93d0 con 0x7fa85410b740 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa852baf700 1 -- 172.21.15.57:0/3517191855 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515308457 0 0) 0x7fa84c001490 con 0x7fa85410bb90 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa8533b0700 1 --2- 172.21.15.57:0/3517191855 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8540f5a10 0x7fa85410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa84abaf700 1 --2- 172.21.15.57:0/3517191855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa85410b740 0x7fa85419fc40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fa83c002f70 tx=0x7fa83c00b9f0).ready entity=mon.0 client_cookie=8a3af8192202db8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa852baf700 1 -- 172.21.15.57:0/3517191855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8541a93d0 con 0x7fa85410b740 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa852baf700 1 -- 172.21.15.57:0/3517191855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c00d5c0 con 0x7fa85410b740 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.445 7fa852baf700 1 -- 172.21.15.57:0/3517191855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa83c00d990 con 0x7fa85410b740 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.446 7fa85a68a700 1 -- 172.21.15.57:0/3517191855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa85410b740 msgr2=0x7fa85419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.446 7fa85a68a700 1 --2- 172.21.15.57:0/3517191855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa85410b740 0x7fa85419fc40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fa83c002f70 tx=0x7fa83c00b9f0).stop 2024-04-25T02:06:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.446 7fa85a68a700 1 -- 172.21.15.57:0/3517191855 shutdown_connections 2024-04-25T02:06:35.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.446 7fa85a68a700 1 --2- 172.21.15.57:0/3517191855 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8540f5a10 0x7fa85410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.446 7fa85a68a700 1 --2- 172.21.15.57:0/3517191855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa85410b740 0x7fa85419fc40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.446 7fa85a68a700 1 -- 172.21.15.57:0/3517191855 >> 172.21.15.57:0/3517191855 conn(0x7fa854113a70 msgr2=0x7fa8540f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:35.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.446 7fa85a68a700 1 -- 172.21.15.57:0/3517191855 shutdown_connections 2024-04-25T02:06:35.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.446 7fa85a68a700 1 -- 172.21.15.57:0/3517191855 wait complete. 2024-04-25T02:06:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa85a68a700 1 Processor -- start 2024-04-25T02:06:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa85a68a700 1 -- start start 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa85a68a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8540d7440 0x7fa8540d7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa85a68a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8540d7ec0 0x7fa8541b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa85a68a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8541b27f0 0x7fa8541b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa85a68a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540e6530 con 0x7fa8540d7440 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa85a68a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540c59f0 con 0x7fa8540d7ec0 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa85a68a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540dc600 con 0x7fa8541b27f0 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa8533b0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8540d7440 0x7fa8540d7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa853bb1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8541b27f0 0x7fa8541b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa8533b0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8540d7440 0x7fa8540d7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57096/0 (socket says 172.21.15.57:57096) 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa8533b0700 1 -- 172.21.15.57:0/3285186853 learned_addr learned my addr 172.21.15.57:0/3285186853 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.470 7fa84abaf700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8540d7ec0 0x7fa8541b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa853bb1700 1 -- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8540d7ec0 msgr2=0x7fa8541b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa853bb1700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8540d7ec0 0x7fa8541b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa853bb1700 1 -- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8540d7440 msgr2=0x7fa8540d7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa853bb1700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8540d7440 0x7fa8540d7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa853bb1700 1 -- 172.21.15.57:0/3285186853 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540dce40 con 0x7fa8541b27f0 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa8533b0700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8540d7440 0x7fa8540d7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa853bb1700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8541b27f0 0x7fa8541b2c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa8540ca800 tx=0x7fa84c00c960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa8513ac700 1 -- 172.21.15.57:0/3285186853 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa8540dce40 con 0x7fa8541b27f0 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa8513ac700 1 -- 172.21.15.57:0/3285186853 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c005bb0 con 0x7fa8541b27f0 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8541b98b0 con 0x7fa8541b27f0 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa8513ac700 1 -- 172.21.15.57:0/3285186853 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa84c0048b0 con 0x7fa8541b27f0 2024-04-25T02:06:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8541b9ab0 con 0x7fa8541b27f0 2024-04-25T02:06:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.471 7fa8513ac700 1 -- 172.21.15.57:0/3285186853 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fa84c004ab0 con 0x7fa8541b27f0 2024-04-25T02:06:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.472 7fa8513ac700 1 -- 172.21.15.57:0/3285186853 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fa84c00bcb0 con 0x7fa8541b27f0 2024-04-25T02:06:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.472 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8540f08e0 con 0x7fa8541b27f0 2024-04-25T02:06:35.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.475 7fa8513ac700 1 -- 172.21.15.57:0/3285186853 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fa84c0059a0 con 0x7fa8541b27f0 2024-04-25T02:06:35.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.622 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa8541ac900 con 0x7fa8541b27f0 2024-04-25T02:06:35.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.623 7fa8513ac700 1 -- 172.21.15.57:0/3285186853 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+33566 (secure 0 0 0) 0x7fa8541145f0 con 0x7fa8541b27f0 2024-04-25T02:06:35.630 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:35.633 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","health":{"checks":{},"status":"HEALTH_OK"},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"14","num_mons":3},"osdmap":{"osdmap":{"epoch":25,"num_osds":4,"num_up_osds":4,"num_in_osds":4,"num_remapped_pgs":0}},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":8}],"num_pgs":136,"num_pools":3,"num_objects":0,"data_bytes":0,"bytes_used":4295761920,"bytes_avail":382251294720,"bytes_total":386547056640,"unknown_pgs_ratio":0.94117647409439087},"fsmap":{"epoch":11,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4684}],"up:standby":0},"mgrmap":{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6816","nonce":43033}]},"active_addr":"172.21.15.57:6816/43033","active_change":"2024-04-25 02:05:30.655410","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}},"servicemap":{"epoch":3,"modified":"2024-04-25 02:06:32.675290","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":":/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T02:06:35.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.624 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 >> v1:172.21.15.57:6816/43033 conn(0x7fa8380145b0 legacy=0x7fa838016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.624 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8541b27f0 msgr2=0x7fa8541b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.624 7fa85a68a700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8541b27f0 0x7fa8541b2c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa8540ca800 tx=0x7fa84c00c960).stop 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.624 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 shutdown_connections 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.624 7fa85a68a700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa8541b27f0 0x7fa8541b2c40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.624 7fa85a68a700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8540d7440 0x7fa8540d7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.624 7fa85a68a700 1 --2- 172.21.15.57:0/3285186853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8540d7ec0 0x7fa8541b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.624 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 >> 172.21.15.57:0/3285186853 conn(0x7fa8540c5510 msgr2=0x7fa8540c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.625 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 shutdown_connections 2024-04-25T02:06:35.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.625 7fa85a68a700 1 -- 172.21.15.57:0/3285186853 wait complete. 2024-04-25T02:06:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T02:06:35.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:35.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.769 7f62c6e54700 1 Processor -- start 2024-04-25T02:06:35.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.769 7f62c6e54700 1 -- start start 2024-04-25T02:06:35.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62c6e54700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c010b910 0x7f62c01a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62c6e54700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01a59d0 0x7f62c01a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62c6e54700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c010bd60 con 0x7f62c00f5a10 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62c6e54700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00fa590 con 0x7f62c01a59d0 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62c6e54700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c01a0c50 con 0x7f62c010b910 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62bffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01a59d0 0x7f62c01a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62bf7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f62c00f5a10 0x7f62c010b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55742/0 (socket says 172.21.15.57:55742) 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62beffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c010b910 0x7f62c01a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62bf7fe700 1 -- 172.21.15.57:0/35137428 learned_addr learned my addr 172.21.15.57:0/35137428 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62beffd700 1 -- 172.21.15.57:0/35137428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01a59d0 msgr2=0x7f62c01a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62beffd700 1 --2- 172.21.15.57:0/35137428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01a59d0 0x7f62c01a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62beffd700 1 -- 172.21.15.57:0/35137428 >> v1:172.21.15.57:6789/0 conn(0x7f62c00f5a10 legacy=0x7f62c010b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62beffd700 1 -- 172.21.15.57:0/35137428 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c01a9470 con 0x7f62c010b910 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62be7fc700 1 -- 172.21.15.57:0/35137428 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905820226 0 0) 0x7f62b0001110 con 0x7f62c00f5a10 2024-04-25T02:06:35.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62bffff700 1 --2- 172.21.15.57:0/35137428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01a59d0 0x7f62c01a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62beffd700 1 --2- 172.21.15.57:0/35137428 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c010b910 0x7f62c01a53a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f62c00f47c0 tx=0x7f62b400b9d0).ready entity=mon.2 client_cookie=d53ebe7a3f9f2a23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.770 7f62be7fc700 1 -- 172.21.15.57:0/35137428 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62c01a9470 con 0x7f62c010b910 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62be7fc700 1 -- 172.21.15.57:0/35137428 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400d570 con 0x7f62c010b910 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62be7fc700 1 -- 172.21.15.57:0/35137428 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62b400d940 con 0x7f62c010b910 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62c6e54700 1 -- 172.21.15.57:0/35137428 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c010b910 msgr2=0x7f62c01a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62c6e54700 1 --2- 172.21.15.57:0/35137428 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c010b910 0x7f62c01a53a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f62c00f47c0 tx=0x7f62b400b9d0).stop 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62c6e54700 1 -- 172.21.15.57:0/35137428 shutdown_connections 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62c6e54700 1 --2- 172.21.15.57:0/35137428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01a59d0 0x7f62c01a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62c6e54700 1 --2- 172.21.15.57:0/35137428 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c010b910 0x7f62c01a53a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62c6e54700 1 -- 172.21.15.57:0/35137428 >> 172.21.15.57:0/35137428 conn(0x7f62c0113a70 msgr2=0x7f62c00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62c6e54700 1 -- 172.21.15.57:0/35137428 shutdown_connections 2024-04-25T02:06:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.771 7f62c6e54700 1 -- 172.21.15.57:0/35137428 wait complete. 2024-04-25T02:06:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.795 7f62c6e54700 1 Processor -- start 2024-04-25T02:06:35.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.795 7f62c6e54700 1 -- start start 2024-04-25T02:06:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62c6e54700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01aa780 0x7f62c01aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62c6e54700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c01ab200 0x7f62c01b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62c6e54700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c01b1850 0x7f62c01b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62c6e54700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00cb1d0 con 0x7f62c01b1850 2024-04-25T02:06:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62c6e54700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00e0840 con 0x7f62c01aa780 2024-04-25T02:06:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62c6e54700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00e01f0 con 0x7f62c01ab200 2024-04-25T02:06:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01aa780 0x7f62c01aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c01b1850 0x7f62c01b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01aa780 0x7f62c01aabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60942/0 (socket says 172.21.15.57:60942) 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 -- 172.21.15.57:0/1776008004 learned_addr learned my addr 172.21.15.57:0/1776008004 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62beffd700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c01ab200 0x7f62c01b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 -- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c01ab200 msgr2=0x7f62c01b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c01ab200 0x7f62c01b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 -- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c01b1850 msgr2=0x7f62c01b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c01b1850 0x7f62c01b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 -- 172.21.15.57:0/1776008004 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00dfd90 con 0x7f62c01aa780 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bffff700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c01b1850 0x7f62c01b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bf7fe700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01aa780 0x7f62c01aabd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f62c00d6f20 tx=0x7f62b000c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.796 7f62bcff9700 1 -- 172.21.15.57:0/1776008004 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62c00dfd90 con 0x7f62c01aa780 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.797 7f62bcff9700 1 -- 172.21.15.57:0/1776008004 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b00072e0 con 0x7f62c01aa780 2024-04-25T02:06:35.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.797 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c01b8990 con 0x7f62c01aa780 2024-04-25T02:06:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.797 7f62bcff9700 1 -- 172.21.15.57:0/1776008004 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62b0005810 con 0x7f62c01aa780 2024-04-25T02:06:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.797 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c01b8d70 con 0x7f62c01aa780 2024-04-25T02:06:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.797 7f62bcff9700 1 -- 172.21.15.57:0/1776008004 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f62b0005a10 con 0x7f62c01aa780 2024-04-25T02:06:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.797 7f62bcff9700 1 -- 172.21.15.57:0/1776008004 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f62b00149e0 con 0x7f62c01aa780 2024-04-25T02:06:35.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.798 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c00f08e0 con 0x7f62c01aa780 2024-04-25T02:06:35.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.801 7f62bcff9700 1 -- 172.21.15.57:0/1776008004 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f62b00070d0 con 0x7f62c01aa780 2024-04-25T02:06:35.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.909 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f62c0087810 con 0x7f62a00145b0 2024-04-25T02:06:35.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.916 7f62bcff9700 1 -- 172.21.15.57:0/1776008004 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299771 (unknown 2965378022 0 2316892489) 0x7f62b4006b30 con 0x7f62a00145b0 2024-04-25T02:06:35.927 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:35.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 >> v1:172.21.15.57:6816/43033 conn(0x7f62a00145b0 legacy=0x7f62a0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01aa780 msgr2=0x7f62c01aabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:35.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01aa780 0x7f62c01aabd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f62c00d6f20 tx=0x7f62b000c860).stop 2024-04-25T02:06:35.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 shutdown_connections 2024-04-25T02:06:35.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c01b1850 0x7f62c01b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c01aa780 0x7f62c01aabd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 --2- 172.21.15.57:0/1776008004 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c01ab200 0x7f62c01b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 >> 172.21.15.57:0/1776008004 conn(0x7f62c00c5af0 msgr2=0x7f62c00d7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 shutdown_connections 2024-04-25T02:06:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:35.919 7f62c6e54700 1 -- 172.21.15.57:0/1776008004 wait complete. 2024-04-25T02:06:35.933 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:35.937 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-25 02:06:34.675627","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195080,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292280,"statfs":{"total":386547056640,"available":382251294720,"internally_reserved":4294967296,"allocated":753664,"data_stored":220700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3467,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.181982"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"17","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.867813","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:23.867813","last_peered":"2024-04-25 02:06:23.867813","last_clean":"2024-04-25 02:06:23.867813","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:23.867813","last_undegraded":"2024-04-25 02:06:23.867813","last_fullsized":"2024-04-25 02:06:23.867813","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.469159","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:24.469159","last_peered":"2024-04-25 02:06:24.469159","last_clean":"2024-04-25 02:06:24.469159","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:24.469159","last_undegraded":"2024-04-25 02:06:24.469159","last_fullsized":"2024-04-25 02:06:24.469159","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.862226","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:23.862226","last_peered":"2024-04-25 02:06:23.862226","last_clean":"2024-04-25 02:06:23.862226","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:23.862226","last_undegraded":"2024-04-25 02:06:23.862226","last_fullsized":"2024-04-25 02:06:23.862226","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.868573","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:23.868573","last_peered":"2024-04-25 02:06:23.868573","last_clean":"2024-04-25 02:06:23.868573","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:23.868573","last_undegraded":"2024-04-25 02:06:23.868573","last_fullsized":"2024-04-25 02:06:23.868573","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.865261","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:23.865261","last_peered":"2024-04-25 02:06:23.865261","last_clean":"2024-04-25 02:06:23.865261","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:23.865261","last_undegraded":"2024-04-25 02:06:23.865261","last_fullsized":"2024-04-25 02:06:23.865261","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.468610","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:24.468610","last_peered":"2024-04-25 02:06:24.468610","last_clean":"2024-04-25 02:06:24.468610","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:24.468610","last_undegraded":"2024-04-25 02:06:24.468610","last_fullsized":"2024-04-25 02:06:24.468610","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:24.471668","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:24.471668","last_peered":"2024-04-25 02:06:24.471668","last_clean":"2024-04-25 02:06:24.471668","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:24.471668","last_undegraded":"2024-04-25 02:06:24.471668","last_fullsized":"2024-04-25 02:06:24.471668","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:31.247756","last_change":"2024-04-25 02:06:31.247756","last_active":"2024-04-25 02:06:31.247756","last_peered":"2024-04-25 02:06:31.247756","last_clean":"2024-04-25 02:06:31.247756","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:31.247756","last_undegraded":"2024-04-25 02:06:31.247756","last_fullsized":"2024-04-25 02:06:31.247756","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"0","reported_epoch":"0","state":"unknown","last_fresh":"2024-04-25 02:06:30.241589","last_change":"2024-04-25 02:06:30.241589","last_active":"2024-04-25 02:06:30.241589","last_peered":"2024-04-25 02:06:30.241589","last_clean":"2024-04-25 02:06:30.241589","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25 02:06:30.241589","last_undegraded":"2024-04-25 02:06:30.241589","last_fullsized":"2024-04-25 02:06:30.241589","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"18","reported_epoch":"20","state":"active+clean","last_fresh":"2024-04-25 02:06:23.863819","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:23.863819","last_peered":"2024-04-25 02:06:23.863819","last_clean":"2024-04-25 02:06:23.863819","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:23.863819","last_undegraded":"2024-04-25 02:06:23.863819","last_fullsized":"2024-04-25 02:06:23.863819","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":55175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]}]}]}} 2024-04-25T02:06:38.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.082 7f993abed700 1 Processor -- start 2024-04-25T02:06:39.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.082 7f993abed700 1 -- start start 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f993abed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99340f58a0 0x7f993410c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f993abed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f993410cd40 0x7f99340f2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f993abed700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99340f2640 con 0x7f993410c8f0 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f993abed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340fa210 con 0x7f993410cd40 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f993abed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99340f9540 con 0x7f99340f58a0 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f99337fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99340f58a0 0x7f993410c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f9933fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f993410cd40 0x7f99340f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f99337fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99340f58a0 0x7f993410c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48810/0 (socket says 172.21.15.57:48810) 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f9933fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f993410cd40 0x7f99340f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49880/0 (socket says 172.21.15.57:49880) 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f99337fe700 1 -- 172.21.15.57:0/1999221879 learned_addr learned my addr 172.21.15.57:0/1999221879 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:39.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f9932ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f993410c8f0 0x7f99340f1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47688/0 (socket says 172.21.15.57:47688) 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f9933fff700 1 -- 172.21.15.57:0/1999221879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99340f58a0 msgr2=0x7f993410c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f9933fff700 1 --2- 172.21.15.57:0/1999221879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99340f58a0 0x7f993410c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f9933fff700 1 -- 172.21.15.57:0/1999221879 >> v1:172.21.15.57:6789/0 conn(0x7f993410c8f0 legacy=0x7f99340f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f99327fc700 1 -- 172.21.15.57:0/1999221879 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640762788 0 0) 0x7f991c001110 con 0x7f993410c8f0 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f9933fff700 1 -- 172.21.15.57:0/1999221879 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99341aa560 con 0x7f993410cd40 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f99337fe700 1 --2- 172.21.15.57:0/1999221879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99340f58a0 0x7f993410c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.083 7f9933fff700 1 --2- 172.21.15.57:0/1999221879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f993410cd40 0x7f99340f2010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f99340f62d0 tx=0x7f992c009d70).ready entity=mon.1 client_cookie=4e38692c7a218332 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f99327fc700 1 -- 172.21.15.57:0/1999221879 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99341aa560 con 0x7f993410cd40 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f99327fc700 1 -- 172.21.15.57:0/1999221879 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00b7c0 con 0x7f993410cd40 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f99327fc700 1 -- 172.21.15.57:0/1999221879 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f992c00b9a0 con 0x7f993410cd40 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f993abed700 1 -- 172.21.15.57:0/1999221879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f993410cd40 msgr2=0x7f99340f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f993abed700 1 --2- 172.21.15.57:0/1999221879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f993410cd40 0x7f99340f2010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f99340f62d0 tx=0x7f992c009d70).stop 2024-04-25T02:06:39.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f993abed700 1 -- 172.21.15.57:0/1999221879 shutdown_connections 2024-04-25T02:06:39.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f993abed700 1 --2- 172.21.15.57:0/1999221879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f993410cd40 0x7f99340f2010 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f993abed700 1 --2- 172.21.15.57:0/1999221879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99340f58a0 0x7f993410c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f993abed700 1 -- 172.21.15.57:0/1999221879 >> 172.21.15.57:0/1999221879 conn(0x7f99341139f0 msgr2=0x7f99340f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f993abed700 1 -- 172.21.15.57:0/1999221879 shutdown_connections 2024-04-25T02:06:39.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.084 7f993abed700 1 -- 172.21.15.57:0/1999221879 wait complete. 2024-04-25T02:06:39.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.108 7f993abed700 1 Processor -- start 2024-04-25T02:06:39.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.108 7f993abed700 1 -- start start 2024-04-25T02:06:39.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f993abed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99341ab450 0x7f99341ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f993abed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f99341abed0 0x7f99341b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f993abed700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99341b2500 0x7f99341b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f993abed700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934088f60 con 0x7f99341b2500 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f993abed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340d6bf0 con 0x7f99341abed0 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f993abed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99340d8700 con 0x7f99341ab450 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99341ab450 0x7f99341ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f9932ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f99341abed0 0x7f99341b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99341ab450 0x7f99341ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48818/0 (socket says 172.21.15.57:48818) 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 -- 172.21.15.57:0/998797892 learned_addr learned my addr 172.21.15.57:0/998797892 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f9933fff700 1 --2- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99341b2500 0x7f99341b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 -- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f99341abed0 msgr2=0x7f99341b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 --2- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f99341abed0 0x7f99341b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 -- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99341b2500 msgr2=0x7f99341b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 --2- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99341b2500 0x7f99341b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 -- 172.21.15.57:0/998797892 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340dd710 con 0x7f99341ab450 2024-04-25T02:06:39.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f99337fe700 1 --2- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99341ab450 0x7f99341ab8a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f99340d6f40 tx=0x7f992400ecb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f9930ff9700 1 -- 172.21.15.57:0/998797892 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f99340dd710 con 0x7f99341ab450 2024-04-25T02:06:39.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f9930ff9700 1 -- 172.21.15.57:0/998797892 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992400c620 con 0x7f99341ab450 2024-04-25T02:06:39.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f993abed700 1 -- 172.21.15.57:0/998797892 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99341b95c0 con 0x7f99341ab450 2024-04-25T02:06:39.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f9930ff9700 1 -- 172.21.15.57:0/998797892 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f992400f040 con 0x7f99341ab450 2024-04-25T02:06:39.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.109 7f993abed700 1 -- 172.21.15.57:0/998797892 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99341b99a0 con 0x7f99341ab450 2024-04-25T02:06:39.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.110 7f9930ff9700 1 -- 172.21.15.57:0/998797892 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9924011070 con 0x7f99341ab450 2024-04-25T02:06:39.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.110 7f9930ff9700 1 -- 172.21.15.57:0/998797892 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f9924010040 con 0x7f99341ab450 2024-04-25T02:06:39.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.110 7f993abed700 1 -- 172.21.15.57:0/998797892 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99340f0860 con 0x7f99341ab450 2024-04-25T02:06:39.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.114 7f9930ff9700 1 -- 172.21.15.57:0/998797892 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f992400edf0 con 0x7f99341ab450 2024-04-25T02:06:39.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.221 7f993abed700 1 -- 172.21.15.57:0/998797892 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f9934087810 con 0x7f99180145b0 2024-04-25T02:06:39.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.230 7f9930ff9700 1 -- 172.21.15.57:0/998797892 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306171 (unknown 2965378022 0 3462283583) 0x7f991c001180 con 0x7f99180145b0 2024-04-25T02:06:39.240 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 -- 172.21.15.57:0/998797892 >> v1:172.21.15.57:6816/43033 conn(0x7f99180145b0 legacy=0x7f9918016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 -- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99341ab450 msgr2=0x7f99341ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 --2- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99341ab450 0x7f99341ab8a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f99340d6f40 tx=0x7f992400ecb0).stop 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 -- 172.21.15.57:0/998797892 shutdown_connections 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 --2- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99341b2500 0x7f99341b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 --2- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f99341ab450 0x7f99341ab8a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 --2- 172.21.15.57:0/998797892 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f99341abed0 0x7f99341b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 -- 172.21.15.57:0/998797892 >> 172.21.15.57:0/998797892 conn(0x7f99340c5340 msgr2=0x7f99340c2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 -- 172.21.15.57:0/998797892 shutdown_connections 2024-04-25T02:06:39.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.232 7f993abed700 1 -- 172.21.15.57:0/998797892 wait complete. 2024-04-25T02:06:39.244 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:39.250 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-04-25 02:06:38.676692","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195264,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292096,"statfs":{"total":386547056640,"available":382251106304,"internally_reserved":4294967296,"allocated":950272,"data_stored":284868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3467,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.182185"},"pg_stats":[{"pgid":"5.3e","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.686974","last_change":"2024-04-25 02:06:31.680550","last_active":"2024-04-25 02:06:31.686974","last_peered":"2024-04-25 02:06:31.686974","last_clean":"2024-04-25 02:06:31.686974","last_became_active":"2024-04-25 02:06:31.680259","last_became_peered":"2024-04-25 02:06:31.680259","last_unstale":"2024-04-25 02:06:31.686974","last_undegraded":"2024-04-25 02:06:31.686974","last_fullsized":"2024-04-25 02:06:31.686974","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"24'3","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.676414","last_change":"2024-04-25 02:06:31.298552","last_active":"2024-04-25 02:06:31.676414","last_peered":"2024-04-25 02:06:31.676414","last_clean":"2024-04-25 02:06:31.676414","last_became_active":"2024-04-25 02:06:31.298169","last_became_peered":"2024-04-25 02:06:31.298169","last_unstale":"2024-04-25 02:06:31.676414","last_undegraded":"2024-04-25 02:06:31.676414","last_fullsized":"2024-04-25 02:06:31.676414","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661593","last_change":"2024-04-25 02:06:31.655631","last_active":"2024-04-25 02:06:31.661593","last_peered":"2024-04-25 02:06:31.661593","last_clean":"2024-04-25 02:06:31.661593","last_became_active":"2024-04-25 02:06:31.655291","last_became_peered":"2024-04-25 02:06:31.655291","last_unstale":"2024-04-25 02:06:31.661593","last_undegraded":"2024-04-25 02:06:31.661593","last_fullsized":"2024-04-25 02:06:31.661593","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.642608","last_change":"2024-04-25 02:06:31.293657","last_active":"2024-04-25 02:06:31.642608","last_peered":"2024-04-25 02:06:31.642608","last_clean":"2024-04-25 02:06:31.642608","last_became_active":"2024-04-25 02:06:31.293375","last_became_peered":"2024-04-25 02:06:31.293375","last_unstale":"2024-04-25 02:06:31.642608","last_undegraded":"2024-04-25 02:06:31.642608","last_fullsized":"2024-04-25 02:06:31.642608","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661813","last_change":"2024-04-25 02:06:31.660181","last_active":"2024-04-25 02:06:31.661813","last_peered":"2024-04-25 02:06:31.661813","last_clean":"2024-04-25 02:06:31.661813","last_became_active":"2024-04-25 02:06:31.659870","last_became_peered":"2024-04-25 02:06:31.659870","last_unstale":"2024-04-25 02:06:31.661813","last_undegraded":"2024-04-25 02:06:31.661813","last_fullsized":"2024-04-25 02:06:31.661813","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.649795","last_change":"2024-04-25 02:06:31.294351","last_active":"2024-04-25 02:06:31.649795","last_peered":"2024-04-25 02:06:31.649795","last_clean":"2024-04-25 02:06:31.649795","last_became_active":"2024-04-25 02:06:31.293943","last_became_peered":"2024-04-25 02:06:31.293943","last_unstale":"2024-04-25 02:06:31.649795","last_undegraded":"2024-04-25 02:06:31.649795","last_fullsized":"2024-04-25 02:06:31.649795","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.664270","last_change":"2024-04-25 02:06:31.663443","last_active":"2024-04-25 02:06:31.664270","last_peered":"2024-04-25 02:06:31.664270","last_clean":"2024-04-25 02:06:31.664270","last_became_active":"2024-04-25 02:06:31.663091","last_became_peered":"2024-04-25 02:06:31.663091","last_unstale":"2024-04-25 02:06:31.664270","last_undegraded":"2024-04-25 02:06:31.664270","last_fullsized":"2024-04-25 02:06:31.664270","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.664644","last_change":"2024-04-25 02:06:31.297486","last_active":"2024-04-25 02:06:31.664644","last_peered":"2024-04-25 02:06:31.664644","last_clean":"2024-04-25 02:06:31.664644","last_became_active":"2024-04-25 02:06:31.297166","last_became_peered":"2024-04-25 02:06:31.297166","last_unstale":"2024-04-25 02:06:31.664644","last_undegraded":"2024-04-25 02:06:31.664644","last_fullsized":"2024-04-25 02:06:31.664644","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.678643","last_change":"2024-04-25 02:06:31.671000","last_active":"2024-04-25 02:06:31.678643","last_peered":"2024-04-25 02:06:31.678643","last_clean":"2024-04-25 02:06:31.678643","last_became_active":"2024-04-25 02:06:31.670772","last_became_peered":"2024-04-25 02:06:31.670772","last_unstale":"2024-04-25 02:06:31.678643","last_undegraded":"2024-04-25 02:06:31.678643","last_fullsized":"2024-04-25 02:06:31.678643","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.677578","last_change":"2024-04-25 02:06:31.315838","last_active":"2024-04-25 02:06:31.677578","last_peered":"2024-04-25 02:06:31.677578","last_clean":"2024-04-25 02:06:31.677578","last_became_active":"2024-04-25 02:06:31.315519","last_became_peered":"2024-04-25 02:06:31.315519","last_unstale":"2024-04-25 02:06:31.677578","last_undegraded":"2024-04-25 02:06:31.677578","last_fullsized":"2024-04-25 02:06:31.677578","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.681500","last_change":"2024-04-25 02:06:31.679332","last_active":"2024-04-25 02:06:31.681500","last_peered":"2024-04-25 02:06:31.681500","last_clean":"2024-04-25 02:06:31.681500","last_became_active":"2024-04-25 02:06:31.676960","last_became_peered":"2024-04-25 02:06:31.676960","last_unstale":"2024-04-25 02:06:31.681500","last_undegraded":"2024-04-25 02:06:31.681500","last_fullsized":"2024-04-25 02:06:31.681500","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.671702","last_change":"2024-04-25 02:06:31.313067","last_active":"2024-04-25 02:06:31.671702","last_peered":"2024-04-25 02:06:31.671702","last_clean":"2024-04-25 02:06:31.671702","last_became_active":"2024-04-25 02:06:31.312718","last_became_peered":"2024-04-25 02:06:31.312718","last_unstale":"2024-04-25 02:06:31.671702","last_undegraded":"2024-04-25 02:06:31.671702","last_fullsized":"2024-04-25 02:06:31.671702","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661889","last_change":"2024-04-25 02:06:31.660874","last_active":"2024-04-25 02:06:31.661889","last_peered":"2024-04-25 02:06:31.661889","last_clean":"2024-04-25 02:06:31.661889","last_became_active":"2024-04-25 02:06:31.660510","last_became_peered":"2024-04-25 02:06:31.660510","last_unstale":"2024-04-25 02:06:31.661889","last_undegraded":"2024-04-25 02:06:31.661889","last_fullsized":"2024-04-25 02:06:31.661889","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.644619","last_change":"2024-04-25 02:06:31.314824","last_active":"2024-04-25 02:06:31.644619","last_peered":"2024-04-25 02:06:31.644619","last_clean":"2024-04-25 02:06:31.644619","last_became_active":"2024-04-25 02:06:31.314372","last_became_peered":"2024-04-25 02:06:31.314372","last_unstale":"2024-04-25 02:06:31.644619","last_undegraded":"2024-04-25 02:06:31.644619","last_fullsized":"2024-04-25 02:06:31.644619","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661711","last_change":"2024-04-25 02:06:31.657539","last_active":"2024-04-25 02:06:31.661711","last_peered":"2024-04-25 02:06:31.661711","last_clean":"2024-04-25 02:06:31.661711","last_became_active":"2024-04-25 02:06:31.657257","last_became_peered":"2024-04-25 02:06:31.657257","last_unstale":"2024-04-25 02:06:31.661711","last_undegraded":"2024-04-25 02:06:31.661711","last_fullsized":"2024-04-25 02:06:31.661711","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.649683","last_change":"2024-04-25 02:06:31.294015","last_active":"2024-04-25 02:06:31.649683","last_peered":"2024-04-25 02:06:31.649683","last_clean":"2024-04-25 02:06:31.649683","last_became_active":"2024-04-25 02:06:31.293049","last_became_peered":"2024-04-25 02:06:31.293049","last_unstale":"2024-04-25 02:06:31.649683","last_undegraded":"2024-04-25 02:06:31.649683","last_fullsized":"2024-04-25 02:06:31.649683","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680529","last_change":"2024-04-25 02:06:31.673725","last_active":"2024-04-25 02:06:31.680529","last_peered":"2024-04-25 02:06:31.680529","last_clean":"2024-04-25 02:06:31.680529","last_became_active":"2024-04-25 02:06:31.670169","last_became_peered":"2024-04-25 02:06:31.670169","last_unstale":"2024-04-25 02:06:31.680529","last_undegraded":"2024-04-25 02:06:31.680529","last_fullsized":"2024-04-25 02:06:31.680529","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.653344","last_change":"2024-04-25 02:06:31.314007","last_active":"2024-04-25 02:06:31.653344","last_peered":"2024-04-25 02:06:31.653344","last_clean":"2024-04-25 02:06:31.653344","last_became_active":"2024-04-25 02:06:31.313596","last_became_peered":"2024-04-25 02:06:31.313596","last_unstale":"2024-04-25 02:06:31.653344","last_undegraded":"2024-04-25 02:06:31.653344","last_fullsized":"2024-04-25 02:06:31.653344","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680038","last_change":"2024-04-25 02:06:31.667900","last_active":"2024-04-25 02:06:31.680038","last_peered":"2024-04-25 02:06:31.680038","last_clean":"2024-04-25 02:06:31.680038","last_became_active":"2024-04-25 02:06:31.667605","last_became_peered":"2024-04-25 02:06:31.667605","last_unstale":"2024-04-25 02:06:31.680038","last_undegraded":"2024-04-25 02:06:31.680038","last_fullsized":"2024-04-25 02:06:31.680038","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.648159","last_change":"2024-04-25 02:06:31.295147","last_active":"2024-04-25 02:06:31.648159","last_peered":"2024-04-25 02:06:31.648159","last_clean":"2024-04-25 02:06:31.648159","last_became_active":"2024-04-25 02:06:31.294648","last_became_peered":"2024-04-25 02:06:31.294648","last_unstale":"2024-04-25 02:06:31.648159","last_undegraded":"2024-04-25 02:06:31.648159","last_fullsized":"2024-04-25 02:06:31.648159","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680288","last_change":"2024-04-25 02:06:31.669881","last_active":"2024-04-25 02:06:31.680288","last_peered":"2024-04-25 02:06:31.680288","last_clean":"2024-04-25 02:06:31.680288","last_became_active":"2024-04-25 02:06:31.669570","last_became_peered":"2024-04-25 02:06:31.669570","last_unstale":"2024-04-25 02:06:31.680288","last_undegraded":"2024-04-25 02:06:31.680288","last_fullsized":"2024-04-25 02:06:31.680288","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.651823","last_change":"2024-04-25 02:06:31.296406","last_active":"2024-04-25 02:06:31.651823","last_peered":"2024-04-25 02:06:31.651823","last_clean":"2024-04-25 02:06:31.651823","last_became_active":"2024-04-25 02:06:31.296090","last_became_peered":"2024-04-25 02:06:31.296090","last_unstale":"2024-04-25 02:06:31.651823","last_undegraded":"2024-04-25 02:06:31.651823","last_fullsized":"2024-04-25 02:06:31.651823","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687473","last_change":"2024-04-25 02:06:31.683242","last_active":"2024-04-25 02:06:31.687473","last_peered":"2024-04-25 02:06:31.687473","last_clean":"2024-04-25 02:06:31.687473","last_became_active":"2024-04-25 02:06:31.682860","last_became_peered":"2024-04-25 02:06:31.682860","last_unstale":"2024-04-25 02:06:31.687473","last_undegraded":"2024-04-25 02:06:31.687473","last_fullsized":"2024-04-25 02:06:31.687473","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"24'4","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687369","last_change":"2024-04-25 02:06:31.302657","last_active":"2024-04-25 02:06:31.687369","last_peered":"2024-04-25 02:06:31.687369","last_clean":"2024-04-25 02:06:31.687369","last_became_active":"2024-04-25 02:06:31.297940","last_became_peered":"2024-04-25 02:06:31.297940","last_unstale":"2024-04-25 02:06:31.687369","last_undegraded":"2024-04-25 02:06:31.687369","last_fullsized":"2024-04-25 02:06:31.687369","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.678665","last_change":"2024-04-25 02:06:31.672160","last_active":"2024-04-25 02:06:31.678665","last_peered":"2024-04-25 02:06:31.678665","last_clean":"2024-04-25 02:06:31.678665","last_became_active":"2024-04-25 02:06:31.671821","last_became_peered":"2024-04-25 02:06:31.671821","last_unstale":"2024-04-25 02:06:31.678665","last_undegraded":"2024-04-25 02:06:31.678665","last_fullsized":"2024-04-25 02:06:31.678665","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.672734","last_change":"2024-04-25 02:06:31.311161","last_active":"2024-04-25 02:06:31.672734","last_peered":"2024-04-25 02:06:31.672734","last_clean":"2024-04-25 02:06:31.672734","last_became_active":"2024-04-25 02:06:31.310822","last_became_peered":"2024-04-25 02:06:31.310822","last_unstale":"2024-04-25 02:06:31.672734","last_undegraded":"2024-04-25 02:06:31.672734","last_fullsized":"2024-04-25 02:06:31.672734","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661594","last_change":"2024-04-25 02:06:31.655684","last_active":"2024-04-25 02:06:31.661594","last_peered":"2024-04-25 02:06:31.661594","last_clean":"2024-04-25 02:06:31.661594","last_became_active":"2024-04-25 02:06:31.655352","last_became_peered":"2024-04-25 02:06:31.655352","last_unstale":"2024-04-25 02:06:31.661594","last_undegraded":"2024-04-25 02:06:31.661594","last_fullsized":"2024-04-25 02:06:31.661594","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.647980","last_change":"2024-04-25 02:06:31.296997","last_active":"2024-04-25 02:06:31.647980","last_peered":"2024-04-25 02:06:31.647980","last_clean":"2024-04-25 02:06:31.647980","last_became_active":"2024-04-25 02:06:31.296696","last_became_peered":"2024-04-25 02:06:31.296696","last_unstale":"2024-04-25 02:06:31.647980","last_undegraded":"2024-04-25 02:06:31.647980","last_fullsized":"2024-04-25 02:06:31.647980","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.681140","last_change":"2024-04-25 02:06:31.674817","last_active":"2024-04-25 02:06:31.681140","last_peered":"2024-04-25 02:06:31.681140","last_clean":"2024-04-25 02:06:31.681140","last_became_active":"2024-04-25 02:06:31.674513","last_became_peered":"2024-04-25 02:06:31.674513","last_unstale":"2024-04-25 02:06:31.681140","last_undegraded":"2024-04-25 02:06:31.681140","last_fullsized":"2024-04-25 02:06:31.681140","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.645621","last_change":"2024-04-25 02:06:31.293789","last_active":"2024-04-25 02:06:31.645621","last_peered":"2024-04-25 02:06:31.645621","last_clean":"2024-04-25 02:06:31.645621","last_became_active":"2024-04-25 02:06:31.293431","last_became_peered":"2024-04-25 02:06:31.293431","last_unstale":"2024-04-25 02:06:31.645621","last_undegraded":"2024-04-25 02:06:31.645621","last_fullsized":"2024-04-25 02:06:31.645621","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.679563","last_change":"2024-04-25 02:06:31.673610","last_active":"2024-04-25 02:06:31.679563","last_peered":"2024-04-25 02:06:31.679563","last_clean":"2024-04-25 02:06:31.679563","last_became_active":"2024-04-25 02:06:31.671708","last_became_peered":"2024-04-25 02:06:31.671708","last_unstale":"2024-04-25 02:06:31.679563","last_undegraded":"2024-04-25 02:06:31.679563","last_fullsized":"2024-04-25 02:06:31.679563","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"24'4","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.681706","last_change":"2024-04-25 02:06:31.316914","last_active":"2024-04-25 02:06:31.681706","last_peered":"2024-04-25 02:06:31.681706","last_clean":"2024-04-25 02:06:31.681706","last_became_active":"2024-04-25 02:06:31.314878","last_became_peered":"2024-04-25 02:06:31.314878","last_unstale":"2024-04-25 02:06:31.681706","last_undegraded":"2024-04-25 02:06:31.681706","last_fullsized":"2024-04-25 02:06:31.681706","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687521","last_change":"2024-04-25 02:06:31.685072","last_active":"2024-04-25 02:06:31.687521","last_peered":"2024-04-25 02:06:31.687521","last_clean":"2024-04-25 02:06:31.687521","last_became_active":"2024-04-25 02:06:31.684565","last_became_peered":"2024-04-25 02:06:31.684565","last_unstale":"2024-04-25 02:06:31.687521","last_undegraded":"2024-04-25 02:06:31.687521","last_fullsized":"2024-04-25 02:06:31.687521","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.653488","last_change":"2024-04-25 02:06:31.310443","last_active":"2024-04-25 02:06:31.653488","last_peered":"2024-04-25 02:06:31.653488","last_clean":"2024-04-25 02:06:31.653488","last_became_active":"2024-04-25 02:06:31.310132","last_became_peered":"2024-04-25 02:06:31.310132","last_unstale":"2024-04-25 02:06:31.653488","last_undegraded":"2024-04-25 02:06:31.653488","last_fullsized":"2024-04-25 02:06:31.653488","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.677245","last_change":"2024-04-25 02:06:31.674030","last_active":"2024-04-25 02:06:31.677245","last_peered":"2024-04-25 02:06:31.677245","last_clean":"2024-04-25 02:06:31.677245","last_became_active":"2024-04-25 02:06:31.673715","last_became_peered":"2024-04-25 02:06:31.673715","last_unstale":"2024-04-25 02:06:31.677245","last_undegraded":"2024-04-25 02:06:31.677245","last_fullsized":"2024-04-25 02:06:31.677245","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.650453","last_change":"2024-04-25 02:06:31.295727","last_active":"2024-04-25 02:06:31.650453","last_peered":"2024-04-25 02:06:31.650453","last_clean":"2024-04-25 02:06:31.650453","last_became_active":"2024-04-25 02:06:31.295392","last_became_peered":"2024-04-25 02:06:31.295392","last_unstale":"2024-04-25 02:06:31.650453","last_undegraded":"2024-04-25 02:06:31.650453","last_fullsized":"2024-04-25 02:06:31.650453","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661666","last_change":"2024-04-25 02:06:31.656668","last_active":"2024-04-25 02:06:31.661666","last_peered":"2024-04-25 02:06:31.661666","last_clean":"2024-04-25 02:06:31.661666","last_became_active":"2024-04-25 02:06:31.656351","last_became_peered":"2024-04-25 02:06:31.656351","last_unstale":"2024-04-25 02:06:31.661666","last_undegraded":"2024-04-25 02:06:31.661666","last_fullsized":"2024-04-25 02:06:31.661666","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.672658","last_change":"2024-04-25 02:06:31.307001","last_active":"2024-04-25 02:06:31.672658","last_peered":"2024-04-25 02:06:31.672658","last_clean":"2024-04-25 02:06:31.672658","last_became_active":"2024-04-25 02:06:31.306663","last_became_peered":"2024-04-25 02:06:31.306663","last_unstale":"2024-04-25 02:06:31.672658","last_undegraded":"2024-04-25 02:06:31.672658","last_fullsized":"2024-04-25 02:06:31.672658","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687495","last_change":"2024-04-25 02:06:31.683338","last_active":"2024-04-25 02:06:31.687495","last_peered":"2024-04-25 02:06:31.687495","last_clean":"2024-04-25 02:06:31.687495","last_became_active":"2024-04-25 02:06:31.683056","last_became_peered":"2024-04-25 02:06:31.683056","last_unstale":"2024-04-25 02:06:31.687495","last_undegraded":"2024-04-25 02:06:31.687495","last_fullsized":"2024-04-25 02:06:31.687495","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.648533","last_change":"2024-04-25 02:06:31.319700","last_active":"2024-04-25 02:06:31.648533","last_peered":"2024-04-25 02:06:31.648533","last_clean":"2024-04-25 02:06:31.648533","last_became_active":"2024-04-25 02:06:31.319323","last_became_peered":"2024-04-25 02:06:31.319323","last_unstale":"2024-04-25 02:06:31.648533","last_undegraded":"2024-04-25 02:06:31.648533","last_fullsized":"2024-04-25 02:06:31.648533","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.670775","last_change":"2024-04-25 02:06:31.664048","last_active":"2024-04-25 02:06:31.670775","last_peered":"2024-04-25 02:06:31.670775","last_clean":"2024-04-25 02:06:31.670775","last_became_active":"2024-04-25 02:06:31.663734","last_became_peered":"2024-04-25 02:06:31.663734","last_unstale":"2024-04-25 02:06:31.670775","last_undegraded":"2024-04-25 02:06:31.670775","last_fullsized":"2024-04-25 02:06:31.670775","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.669349","last_change":"2024-04-25 02:06:31.302274","last_active":"2024-04-25 02:06:31.669349","last_peered":"2024-04-25 02:06:31.669349","last_clean":"2024-04-25 02:06:31.669349","last_became_active":"2024-04-25 02:06:31.301955","last_became_peered":"2024-04-25 02:06:31.301955","last_unstale":"2024-04-25 02:06:31.669349","last_undegraded":"2024-04-25 02:06:31.669349","last_fullsized":"2024-04-25 02:06:31.669349","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680578","last_change":"2024-04-25 02:06:31.675599","last_active":"2024-04-25 02:06:31.680578","last_peered":"2024-04-25 02:06:31.680578","last_clean":"2024-04-25 02:06:31.680578","last_became_active":"2024-04-25 02:06:31.675289","last_became_peered":"2024-04-25 02:06:31.675289","last_unstale":"2024-04-25 02:06:31.680578","last_undegraded":"2024-04-25 02:06:31.680578","last_fullsized":"2024-04-25 02:06:31.680578","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.646477","last_change":"2024-04-25 02:06:31.294337","last_active":"2024-04-25 02:06:31.646477","last_peered":"2024-04-25 02:06:31.646477","last_clean":"2024-04-25 02:06:31.646477","last_became_active":"2024-04-25 02:06:31.293440","last_became_peered":"2024-04-25 02:06:31.293440","last_unstale":"2024-04-25 02:06:31.646477","last_undegraded":"2024-04-25 02:06:31.646477","last_fullsized":"2024-04-25 02:06:31.646477","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.671304","last_change":"2024-04-25 02:06:31.667556","last_active":"2024-04-25 02:06:31.671304","last_peered":"2024-04-25 02:06:31.671304","last_clean":"2024-04-25 02:06:31.671304","last_became_active":"2024-04-25 02:06:31.667243","last_became_peered":"2024-04-25 02:06:31.667243","last_unstale":"2024-04-25 02:06:31.671304","last_undegraded":"2024-04-25 02:06:31.671304","last_fullsized":"2024-04-25 02:06:31.671304","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.644715","last_change":"2024-04-25 02:06:31.315533","last_active":"2024-04-25 02:06:31.644715","last_peered":"2024-04-25 02:06:31.644715","last_clean":"2024-04-25 02:06:31.644715","last_became_active":"2024-04-25 02:06:31.315195","last_became_peered":"2024-04-25 02:06:31.315195","last_unstale":"2024-04-25 02:06:31.644715","last_undegraded":"2024-04-25 02:06:31.644715","last_fullsized":"2024-04-25 02:06:31.644715","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.671626","last_change":"2024-04-25 02:06:31.659539","last_active":"2024-04-25 02:06:31.671626","last_peered":"2024-04-25 02:06:31.671626","last_clean":"2024-04-25 02:06:31.671626","last_became_active":"2024-04-25 02:06:31.658485","last_became_peered":"2024-04-25 02:06:31.658485","last_unstale":"2024-04-25 02:06:31.671626","last_undegraded":"2024-04-25 02:06:31.671626","last_fullsized":"2024-04-25 02:06:31.671626","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.649691","last_change":"2024-04-25 02:06:31.309842","last_active":"2024-04-25 02:06:31.649691","last_peered":"2024-04-25 02:06:31.649691","last_clean":"2024-04-25 02:06:31.649691","last_became_active":"2024-04-25 02:06:31.309525","last_became_peered":"2024-04-25 02:06:31.309525","last_unstale":"2024-04-25 02:06:31.649691","last_undegraded":"2024-04-25 02:06:31.649691","last_fullsized":"2024-04-25 02:06:31.649691","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.686824","last_change":"2024-04-25 02:06:31.678727","last_active":"2024-04-25 02:06:31.686824","last_peered":"2024-04-25 02:06:31.686824","last_clean":"2024-04-25 02:06:31.686824","last_became_active":"2024-04-25 02:06:31.678224","last_became_peered":"2024-04-25 02:06:31.678224","last_unstale":"2024-04-25 02:06:31.686824","last_undegraded":"2024-04-25 02:06:31.686824","last_fullsized":"2024-04-25 02:06:31.686824","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.654207","last_change":"2024-04-25 02:06:31.311056","last_active":"2024-04-25 02:06:31.654207","last_peered":"2024-04-25 02:06:31.654207","last_clean":"2024-04-25 02:06:31.654207","last_became_active":"2024-04-25 02:06:31.310747","last_became_peered":"2024-04-25 02:06:31.310747","last_unstale":"2024-04-25 02:06:31.654207","last_undegraded":"2024-04-25 02:06:31.654207","last_fullsized":"2024-04-25 02:06:31.654207","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.657749","last_change":"2024-04-25 02:06:31.656519","last_active":"2024-04-25 02:06:31.657749","last_peered":"2024-04-25 02:06:31.657749","last_clean":"2024-04-25 02:06:31.657749","last_became_active":"2024-04-25 02:06:31.656165","last_became_peered":"2024-04-25 02:06:31.656165","last_unstale":"2024-04-25 02:06:31.657749","last_undegraded":"2024-04-25 02:06:31.657749","last_fullsized":"2024-04-25 02:06:31.657749","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"25'1","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:32.672889","last_change":"2024-04-25 02:06:31.295561","last_active":"2024-04-25 02:06:32.672889","last_peered":"2024-04-25 02:06:32.672889","last_clean":"2024-04-25 02:06:32.672889","last_became_active":"2024-04-25 02:06:31.295229","last_became_peered":"2024-04-25 02:06:31.295229","last_unstale":"2024-04-25 02:06:32.672889","last_undegraded":"2024-04-25 02:06:32.672889","last_fullsized":"2024-04-25 02:06:32.672889","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661648","last_change":"2024-04-25 02:06:31.656634","last_active":"2024-04-25 02:06:31.661648","last_peered":"2024-04-25 02:06:31.661648","last_clean":"2024-04-25 02:06:31.661648","last_became_active":"2024-04-25 02:06:31.656299","last_became_peered":"2024-04-25 02:06:31.656299","last_unstale":"2024-04-25 02:06:31.661648","last_undegraded":"2024-04-25 02:06:31.661648","last_fullsized":"2024-04-25 02:06:31.661648","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.666353","last_change":"2024-04-25 02:06:31.316232","last_active":"2024-04-25 02:06:31.666353","last_peered":"2024-04-25 02:06:31.666353","last_clean":"2024-04-25 02:06:31.666353","last_became_active":"2024-04-25 02:06:31.315847","last_became_peered":"2024-04-25 02:06:31.315847","last_unstale":"2024-04-25 02:06:31.666353","last_undegraded":"2024-04-25 02:06:31.666353","last_fullsized":"2024-04-25 02:06:31.666353","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661812","last_change":"2024-04-25 02:06:31.660313","last_active":"2024-04-25 02:06:31.661812","last_peered":"2024-04-25 02:06:31.661812","last_clean":"2024-04-25 02:06:31.661812","last_became_active":"2024-04-25 02:06:31.659582","last_became_peered":"2024-04-25 02:06:31.659582","last_unstale":"2024-04-25 02:06:31.661812","last_undegraded":"2024-04-25 02:06:31.661812","last_fullsized":"2024-04-25 02:06:31.661812","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.648660","last_change":"2024-04-25 02:06:31.301802","last_active":"2024-04-25 02:06:31.648660","last_peered":"2024-04-25 02:06:31.648660","last_clean":"2024-04-25 02:06:31.648660","last_became_active":"2024-04-25 02:06:31.301286","last_became_peered":"2024-04-25 02:06:31.301286","last_unstale":"2024-04-25 02:06:31.648660","last_undegraded":"2024-04-25 02:06:31.648660","last_fullsized":"2024-04-25 02:06:31.648660","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680376","last_change":"2024-04-25 02:06:31.674506","last_active":"2024-04-25 02:06:31.680376","last_peered":"2024-04-25 02:06:31.680376","last_clean":"2024-04-25 02:06:31.680376","last_became_active":"2024-04-25 02:06:31.674199","last_became_peered":"2024-04-25 02:06:31.674199","last_unstale":"2024-04-25 02:06:31.680376","last_undegraded":"2024-04-25 02:06:31.680376","last_fullsized":"2024-04-25 02:06:31.680376","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.672603","last_change":"2024-04-25 02:06:31.313000","last_active":"2024-04-25 02:06:31.672603","last_peered":"2024-04-25 02:06:31.672603","last_clean":"2024-04-25 02:06:31.672603","last_became_active":"2024-04-25 02:06:31.312650","last_became_peered":"2024-04-25 02:06:31.312650","last_unstale":"2024-04-25 02:06:31.672603","last_undegraded":"2024-04-25 02:06:31.672603","last_fullsized":"2024-04-25 02:06:31.672603","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.675224","last_change":"2024-04-25 02:06:31.666270","last_active":"2024-04-25 02:06:31.675224","last_peered":"2024-04-25 02:06:31.675224","last_clean":"2024-04-25 02:06:31.675224","last_became_active":"2024-04-25 02:06:31.665820","last_became_peered":"2024-04-25 02:06:31.665820","last_unstale":"2024-04-25 02:06:31.675224","last_undegraded":"2024-04-25 02:06:31.675224","last_fullsized":"2024-04-25 02:06:31.675224","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.646581","last_change":"2024-04-25 02:06:31.314214","last_active":"2024-04-25 02:06:31.646581","last_peered":"2024-04-25 02:06:31.646581","last_clean":"2024-04-25 02:06:31.646581","last_became_active":"2024-04-25 02:06:31.313851","last_became_peered":"2024-04-25 02:06:31.313851","last_unstale":"2024-04-25 02:06:31.646581","last_undegraded":"2024-04-25 02:06:31.646581","last_fullsized":"2024-04-25 02:06:31.646581","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.678523","last_change":"2024-04-25 02:06:31.672719","last_active":"2024-04-25 02:06:31.678523","last_peered":"2024-04-25 02:06:31.678523","last_clean":"2024-04-25 02:06:31.678523","last_became_active":"2024-04-25 02:06:31.672404","last_became_peered":"2024-04-25 02:06:31.672404","last_unstale":"2024-04-25 02:06:31.678523","last_undegraded":"2024-04-25 02:06:31.678523","last_fullsized":"2024-04-25 02:06:31.678523","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.645023","last_change":"2024-04-25 02:06:31.315755","last_active":"2024-04-25 02:06:31.645023","last_peered":"2024-04-25 02:06:31.645023","last_clean":"2024-04-25 02:06:31.645023","last_became_active":"2024-04-25 02:06:31.315340","last_became_peered":"2024-04-25 02:06:31.315340","last_unstale":"2024-04-25 02:06:31.645023","last_undegraded":"2024-04-25 02:06:31.645023","last_fullsized":"2024-04-25 02:06:31.645023","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.668252","last_change":"2024-04-25 02:06:31.663540","last_active":"2024-04-25 02:06:31.668252","last_peered":"2024-04-25 02:06:31.668252","last_clean":"2024-04-25 02:06:31.668252","last_became_active":"2024-04-25 02:06:31.663225","last_became_peered":"2024-04-25 02:06:31.663225","last_unstale":"2024-04-25 02:06:31.668252","last_undegraded":"2024-04-25 02:06:31.668252","last_fullsized":"2024-04-25 02:06:31.668252","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.650115","last_change":"2024-04-25 02:06:31.300657","last_active":"2024-04-25 02:06:31.650115","last_peered":"2024-04-25 02:06:31.650115","last_clean":"2024-04-25 02:06:31.650115","last_became_active":"2024-04-25 02:06:31.300302","last_became_peered":"2024-04-25 02:06:31.300302","last_unstale":"2024-04-25 02:06:31.650115","last_undegraded":"2024-04-25 02:06:31.650115","last_fullsized":"2024-04-25 02:06:31.650115","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680618","last_change":"2024-04-25 02:06:31.675755","last_active":"2024-04-25 02:06:31.680618","last_peered":"2024-04-25 02:06:31.680618","last_clean":"2024-04-25 02:06:31.680618","last_became_active":"2024-04-25 02:06:31.675452","last_became_peered":"2024-04-25 02:06:31.675452","last_unstale":"2024-04-25 02:06:31.680618","last_undegraded":"2024-04-25 02:06:31.680618","last_fullsized":"2024-04-25 02:06:31.680618","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.682994","last_change":"2024-04-25 02:06:31.319875","last_active":"2024-04-25 02:06:31.682994","last_peered":"2024-04-25 02:06:31.682994","last_clean":"2024-04-25 02:06:31.682994","last_became_active":"2024-04-25 02:06:31.318476","last_became_peered":"2024-04-25 02:06:31.318476","last_unstale":"2024-04-25 02:06:31.682994","last_undegraded":"2024-04-25 02:06:31.682994","last_fullsized":"2024-04-25 02:06:31.682994","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661729","last_change":"2024-04-25 02:06:31.658735","last_active":"2024-04-25 02:06:31.661729","last_peered":"2024-04-25 02:06:31.661729","last_clean":"2024-04-25 02:06:31.661729","last_became_active":"2024-04-25 02:06:31.658438","last_became_peered":"2024-04-25 02:06:31.658438","last_unstale":"2024-04-25 02:06:31.661729","last_undegraded":"2024-04-25 02:06:31.661729","last_fullsized":"2024-04-25 02:06:31.661729","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.659200","last_change":"2024-04-25 02:06:31.298744","last_active":"2024-04-25 02:06:31.659200","last_peered":"2024-04-25 02:06:31.659200","last_clean":"2024-04-25 02:06:31.659200","last_became_active":"2024-04-25 02:06:31.298243","last_became_peered":"2024-04-25 02:06:31.298243","last_unstale":"2024-04-25 02:06:31.659200","last_undegraded":"2024-04-25 02:06:31.659200","last_fullsized":"2024-04-25 02:06:31.659200","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.676039","last_change":"2024-04-25 02:06:31.672927","last_active":"2024-04-25 02:06:31.676039","last_peered":"2024-04-25 02:06:31.676039","last_clean":"2024-04-25 02:06:31.676039","last_became_active":"2024-04-25 02:06:31.672618","last_became_peered":"2024-04-25 02:06:31.672618","last_unstale":"2024-04-25 02:06:31.676039","last_undegraded":"2024-04-25 02:06:31.676039","last_fullsized":"2024-04-25 02:06:31.676039","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.683576","last_change":"2024-04-25 02:06:31.320055","last_active":"2024-04-25 02:06:31.683576","last_peered":"2024-04-25 02:06:31.683576","last_clean":"2024-04-25 02:06:31.683576","last_became_active":"2024-04-25 02:06:31.319448","last_became_peered":"2024-04-25 02:06:31.319448","last_unstale":"2024-04-25 02:06:31.683576","last_undegraded":"2024-04-25 02:06:31.683576","last_fullsized":"2024-04-25 02:06:31.683576","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680121","last_change":"2024-04-25 02:06:31.667512","last_active":"2024-04-25 02:06:31.680121","last_peered":"2024-04-25 02:06:31.680121","last_clean":"2024-04-25 02:06:31.680121","last_became_active":"2024-04-25 02:06:31.667193","last_became_peered":"2024-04-25 02:06:31.667193","last_unstale":"2024-04-25 02:06:31.680121","last_undegraded":"2024-04-25 02:06:31.680121","last_fullsized":"2024-04-25 02:06:31.680121","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.642582","last_change":"2024-04-25 02:06:31.294777","last_active":"2024-04-25 02:06:31.642582","last_peered":"2024-04-25 02:06:31.642582","last_clean":"2024-04-25 02:06:31.642582","last_became_active":"2024-04-25 02:06:31.294390","last_became_peered":"2024-04-25 02:06:31.294390","last_unstale":"2024-04-25 02:06:31.642582","last_undegraded":"2024-04-25 02:06:31.642582","last_fullsized":"2024-04-25 02:06:31.642582","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661436","last_change":"2024-04-25 02:06:31.659847","last_active":"2024-04-25 02:06:31.661436","last_peered":"2024-04-25 02:06:31.661436","last_clean":"2024-04-25 02:06:31.661436","last_became_active":"2024-04-25 02:06:31.659520","last_became_peered":"2024-04-25 02:06:31.659520","last_unstale":"2024-04-25 02:06:31.661436","last_undegraded":"2024-04-25 02:06:31.661436","last_fullsized":"2024-04-25 02:06:31.661436","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.643141","last_change":"2024-04-25 02:06:31.300178","last_active":"2024-04-25 02:06:31.643141","last_peered":"2024-04-25 02:06:31.643141","last_clean":"2024-04-25 02:06:31.643141","last_became_active":"2024-04-25 02:06:31.298498","last_became_peered":"2024-04-25 02:06:31.298498","last_unstale":"2024-04-25 02:06:31.643141","last_undegraded":"2024-04-25 02:06:31.643141","last_fullsized":"2024-04-25 02:06:31.643141","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.681519","last_change":"2024-04-25 02:06:31.679335","last_active":"2024-04-25 02:06:31.681519","last_peered":"2024-04-25 02:06:31.681519","last_clean":"2024-04-25 02:06:31.681519","last_became_active":"2024-04-25 02:06:31.676730","last_became_peered":"2024-04-25 02:06:31.676730","last_unstale":"2024-04-25 02:06:31.681519","last_undegraded":"2024-04-25 02:06:31.681519","last_fullsized":"2024-04-25 02:06:31.681519","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.641811","last_change":"2024-04-25 02:06:31.304042","last_active":"2024-04-25 02:06:31.641811","last_peered":"2024-04-25 02:06:31.641811","last_clean":"2024-04-25 02:06:31.641811","last_became_active":"2024-04-25 02:06:31.303603","last_became_peered":"2024-04-25 02:06:31.303603","last_unstale":"2024-04-25 02:06:31.641811","last_undegraded":"2024-04-25 02:06:31.641811","last_fullsized":"2024-04-25 02:06:31.641811","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.674474","last_change":"2024-04-25 02:06:31.665056","last_active":"2024-04-25 02:06:31.674474","last_peered":"2024-04-25 02:06:31.674474","last_clean":"2024-04-25 02:06:31.674474","last_became_active":"2024-04-25 02:06:31.664757","last_became_peered":"2024-04-25 02:06:31.664757","last_unstale":"2024-04-25 02:06:31.674474","last_undegraded":"2024-04-25 02:06:31.674474","last_fullsized":"2024-04-25 02:06:31.674474","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.645120","last_change":"2024-04-25 02:06:31.315979","last_active":"2024-04-25 02:06:31.645120","last_peered":"2024-04-25 02:06:31.645120","last_clean":"2024-04-25 02:06:31.645120","last_became_active":"2024-04-25 02:06:31.315605","last_became_peered":"2024-04-25 02:06:31.315605","last_unstale":"2024-04-25 02:06:31.645120","last_undegraded":"2024-04-25 02:06:31.645120","last_fullsized":"2024-04-25 02:06:31.645120","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.657746","last_change":"2024-04-25 02:06:31.656533","last_active":"2024-04-25 02:06:31.657746","last_peered":"2024-04-25 02:06:31.657746","last_clean":"2024-04-25 02:06:31.657746","last_became_active":"2024-04-25 02:06:31.656194","last_became_peered":"2024-04-25 02:06:31.656194","last_unstale":"2024-04-25 02:06:31.657746","last_undegraded":"2024-04-25 02:06:31.657746","last_fullsized":"2024-04-25 02:06:31.657746","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.641684","last_change":"2024-04-25 02:06:31.292372","last_active":"2024-04-25 02:06:31.641684","last_peered":"2024-04-25 02:06:31.641684","last_clean":"2024-04-25 02:06:31.641684","last_became_active":"2024-04-25 02:06:31.292040","last_became_peered":"2024-04-25 02:06:31.292040","last_unstale":"2024-04-25 02:06:31.641684","last_undegraded":"2024-04-25 02:06:31.641684","last_fullsized":"2024-04-25 02:06:31.641684","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687544","last_change":"2024-04-25 02:06:31.685220","last_active":"2024-04-25 02:06:31.687544","last_peered":"2024-04-25 02:06:31.687544","last_clean":"2024-04-25 02:06:31.687544","last_became_active":"2024-04-25 02:06:31.684773","last_became_peered":"2024-04-25 02:06:31.684773","last_unstale":"2024-04-25 02:06:31.687544","last_undegraded":"2024-04-25 02:06:31.687544","last_fullsized":"2024-04-25 02:06:31.687544","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.666289","last_change":"2024-04-25 02:06:31.320076","last_active":"2024-04-25 02:06:31.666289","last_peered":"2024-04-25 02:06:31.666289","last_clean":"2024-04-25 02:06:31.666289","last_became_active":"2024-04-25 02:06:31.318293","last_became_peered":"2024-04-25 02:06:31.318293","last_unstale":"2024-04-25 02:06:31.666289","last_undegraded":"2024-04-25 02:06:31.666289","last_fullsized":"2024-04-25 02:06:31.666289","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687429","last_change":"2024-04-25 02:06:31.682876","last_active":"2024-04-25 02:06:31.687429","last_peered":"2024-04-25 02:06:31.687429","last_clean":"2024-04-25 02:06:31.687429","last_became_active":"2024-04-25 02:06:31.682567","last_became_peered":"2024-04-25 02:06:31.682567","last_unstale":"2024-04-25 02:06:31.687429","last_undegraded":"2024-04-25 02:06:31.687429","last_fullsized":"2024-04-25 02:06:31.687429","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.650666","last_change":"2024-04-25 02:06:31.314905","last_active":"2024-04-25 02:06:31.650666","last_peered":"2024-04-25 02:06:31.650666","last_clean":"2024-04-25 02:06:31.650666","last_became_active":"2024-04-25 02:06:31.314596","last_became_peered":"2024-04-25 02:06:31.314596","last_unstale":"2024-04-25 02:06:31.650666","last_undegraded":"2024-04-25 02:06:31.650666","last_fullsized":"2024-04-25 02:06:31.650666","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.679177","last_change":"2024-04-25 02:06:31.674997","last_active":"2024-04-25 02:06:31.679177","last_peered":"2024-04-25 02:06:31.679177","last_clean":"2024-04-25 02:06:31.679177","last_became_active":"2024-04-25 02:06:31.674698","last_became_peered":"2024-04-25 02:06:31.674698","last_unstale":"2024-04-25 02:06:31.679177","last_undegraded":"2024-04-25 02:06:31.679177","last_fullsized":"2024-04-25 02:06:31.679177","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.681510","last_change":"2024-04-25 02:06:31.316155","last_active":"2024-04-25 02:06:31.681510","last_peered":"2024-04-25 02:06:31.681510","last_clean":"2024-04-25 02:06:31.681510","last_became_active":"2024-04-25 02:06:31.315819","last_became_peered":"2024-04-25 02:06:31.315819","last_unstale":"2024-04-25 02:06:31.681510","last_undegraded":"2024-04-25 02:06:31.681510","last_fullsized":"2024-04-25 02:06:31.681510","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687506","last_change":"2024-04-25 02:06:31.683917","last_active":"2024-04-25 02:06:31.687506","last_peered":"2024-04-25 02:06:31.687506","last_clean":"2024-04-25 02:06:31.687506","last_became_active":"2024-04-25 02:06:31.683624","last_became_peered":"2024-04-25 02:06:31.683624","last_unstale":"2024-04-25 02:06:31.687506","last_undegraded":"2024-04-25 02:06:31.687506","last_fullsized":"2024-04-25 02:06:31.687506","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.683155","last_change":"2024-04-25 02:06:31.312506","last_active":"2024-04-25 02:06:31.683155","last_peered":"2024-04-25 02:06:31.683155","last_clean":"2024-04-25 02:06:31.683155","last_became_active":"2024-04-25 02:06:31.312138","last_became_peered":"2024-04-25 02:06:31.312138","last_unstale":"2024-04-25 02:06:31.683155","last_undegraded":"2024-04-25 02:06:31.683155","last_fullsized":"2024-04-25 02:06:31.683155","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.683150","last_change":"2024-04-25 02:06:31.679876","last_active":"2024-04-25 02:06:31.683150","last_peered":"2024-04-25 02:06:31.683150","last_clean":"2024-04-25 02:06:31.683150","last_became_active":"2024-04-25 02:06:31.677799","last_became_peered":"2024-04-25 02:06:31.677799","last_unstale":"2024-04-25 02:06:31.683150","last_undegraded":"2024-04-25 02:06:31.683150","last_fullsized":"2024-04-25 02:06:31.683150","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.679497","last_change":"2024-04-25 02:06:31.298854","last_active":"2024-04-25 02:06:31.679497","last_peered":"2024-04-25 02:06:31.679497","last_clean":"2024-04-25 02:06:31.679497","last_became_active":"2024-04-25 02:06:31.298227","last_became_peered":"2024-04-25 02:06:31.298227","last_unstale":"2024-04-25 02:06:31.679497","last_undegraded":"2024-04-25 02:06:31.679497","last_fullsized":"2024-04-25 02:06:31.679497","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687206","last_change":"2024-04-25 02:06:31.681740","last_active":"2024-04-25 02:06:31.687206","last_peered":"2024-04-25 02:06:31.687206","last_clean":"2024-04-25 02:06:31.687206","last_became_active":"2024-04-25 02:06:31.681540","last_became_peered":"2024-04-25 02:06:31.681540","last_unstale":"2024-04-25 02:06:31.687206","last_undegraded":"2024-04-25 02:06:31.687206","last_fullsized":"2024-04-25 02:06:31.687206","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.647749","last_change":"2024-04-25 02:06:31.311262","last_active":"2024-04-25 02:06:31.647749","last_peered":"2024-04-25 02:06:31.647749","last_clean":"2024-04-25 02:06:31.647749","last_became_active":"2024-04-25 02:06:31.307304","last_became_peered":"2024-04-25 02:06:31.307304","last_unstale":"2024-04-25 02:06:31.647749","last_undegraded":"2024-04-25 02:06:31.647749","last_fullsized":"2024-04-25 02:06:31.647749","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661910","last_change":"2024-04-25 02:06:31.660874","last_active":"2024-04-25 02:06:31.661910","last_peered":"2024-04-25 02:06:31.661910","last_clean":"2024-04-25 02:06:31.661910","last_became_active":"2024-04-25 02:06:31.660520","last_became_peered":"2024-04-25 02:06:31.660520","last_unstale":"2024-04-25 02:06:31.661910","last_undegraded":"2024-04-25 02:06:31.661910","last_fullsized":"2024-04-25 02:06:31.661910","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.645569","last_change":"2024-04-25 02:06:31.316372","last_active":"2024-04-25 02:06:31.645569","last_peered":"2024-04-25 02:06:31.645569","last_clean":"2024-04-25 02:06:31.645569","last_became_active":"2024-04-25 02:06:31.316027","last_became_peered":"2024-04-25 02:06:31.316027","last_unstale":"2024-04-25 02:06:31.645569","last_undegraded":"2024-04-25 02:06:31.645569","last_fullsized":"2024-04-25 02:06:31.645569","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.675269","last_change":"2024-04-25 02:06:31.670665","last_active":"2024-04-25 02:06:31.675269","last_peered":"2024-04-25 02:06:31.675269","last_clean":"2024-04-25 02:06:31.675269","last_became_active":"2024-04-25 02:06:31.670358","last_became_peered":"2024-04-25 02:06:31.670358","last_unstale":"2024-04-25 02:06:31.675269","last_undegraded":"2024-04-25 02:06:31.675269","last_fullsized":"2024-04-25 02:06:31.675269","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"24'4","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.681538","last_change":"2024-04-25 02:06:31.320576","last_active":"2024-04-25 02:06:31.681538","last_peered":"2024-04-25 02:06:31.681538","last_clean":"2024-04-25 02:06:31.681538","last_became_active":"2024-04-25 02:06:31.320166","last_became_peered":"2024-04-25 02:06:31.320166","last_unstale":"2024-04-25 02:06:31.681538","last_undegraded":"2024-04-25 02:06:31.681538","last_fullsized":"2024-04-25 02:06:31.681538","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687367","last_change":"2024-04-25 02:06:31.682141","last_active":"2024-04-25 02:06:31.687367","last_peered":"2024-04-25 02:06:31.687367","last_clean":"2024-04-25 02:06:31.687367","last_became_active":"2024-04-25 02:06:31.681868","last_became_peered":"2024-04-25 02:06:31.681868","last_unstale":"2024-04-25 02:06:31.687367","last_undegraded":"2024-04-25 02:06:31.687367","last_fullsized":"2024-04-25 02:06:31.687367","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.677643","last_change":"2024-04-25 02:06:31.320076","last_active":"2024-04-25 02:06:31.677643","last_peered":"2024-04-25 02:06:31.677643","last_clean":"2024-04-25 02:06:31.677643","last_became_active":"2024-04-25 02:06:31.319727","last_became_peered":"2024-04-25 02:06:31.319727","last_unstale":"2024-04-25 02:06:31.677643","last_undegraded":"2024-04-25 02:06:31.677643","last_fullsized":"2024-04-25 02:06:31.677643","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680016","last_change":"2024-04-25 02:06:31.667876","last_active":"2024-04-25 02:06:31.680016","last_peered":"2024-04-25 02:06:31.680016","last_clean":"2024-04-25 02:06:31.680016","last_became_active":"2024-04-25 02:06:31.667328","last_became_peered":"2024-04-25 02:06:31.667328","last_unstale":"2024-04-25 02:06:31.680016","last_undegraded":"2024-04-25 02:06:31.680016","last_fullsized":"2024-04-25 02:06:31.680016","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.676545","last_change":"2024-04-25 02:06:31.298569","last_active":"2024-04-25 02:06:31.676545","last_peered":"2024-04-25 02:06:31.676545","last_clean":"2024-04-25 02:06:31.676545","last_became_active":"2024-04-25 02:06:31.298197","last_became_peered":"2024-04-25 02:06:31.298197","last_unstale":"2024-04-25 02:06:31.676545","last_undegraded":"2024-04-25 02:06:31.676545","last_fullsized":"2024-04-25 02:06:31.676545","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661454","last_change":"2024-04-25 02:06:31.659296","last_active":"2024-04-25 02:06:31.661454","last_peered":"2024-04-25 02:06:31.661454","last_clean":"2024-04-25 02:06:31.661454","last_became_active":"2024-04-25 02:06:31.658960","last_became_peered":"2024-04-25 02:06:31.658960","last_unstale":"2024-04-25 02:06:31.661454","last_undegraded":"2024-04-25 02:06:31.661454","last_fullsized":"2024-04-25 02:06:31.661454","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.666620","last_change":"2024-04-25 02:06:31.319833","last_active":"2024-04-25 02:06:31.666620","last_peered":"2024-04-25 02:06:31.666620","last_clean":"2024-04-25 02:06:31.666620","last_became_active":"2024-04-25 02:06:31.319190","last_became_peered":"2024-04-25 02:06:31.319190","last_unstale":"2024-04-25 02:06:31.666620","last_undegraded":"2024-04-25 02:06:31.666620","last_fullsized":"2024-04-25 02:06:31.666620","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.681250","last_change":"2024-04-25 02:06:31.676938","last_active":"2024-04-25 02:06:31.681250","last_peered":"2024-04-25 02:06:31.681250","last_clean":"2024-04-25 02:06:31.681250","last_became_active":"2024-04-25 02:06:31.676633","last_became_peered":"2024-04-25 02:06:31.676633","last_unstale":"2024-04-25 02:06:31.681250","last_undegraded":"2024-04-25 02:06:31.681250","last_fullsized":"2024-04-25 02:06:31.681250","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.646141","last_change":"2024-04-25 02:06:31.316551","last_active":"2024-04-25 02:06:31.646141","last_peered":"2024-04-25 02:06:31.646141","last_clean":"2024-04-25 02:06:31.646141","last_became_active":"2024-04-25 02:06:31.316219","last_became_peered":"2024-04-25 02:06:31.316219","last_unstale":"2024-04-25 02:06:31.646141","last_undegraded":"2024-04-25 02:06:31.646141","last_fullsized":"2024-04-25 02:06:31.646141","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.676828","last_change":"2024-04-25 02:06:31.674693","last_active":"2024-04-25 02:06:31.676828","last_peered":"2024-04-25 02:06:31.676828","last_clean":"2024-04-25 02:06:31.676828","last_became_active":"2024-04-25 02:06:31.674386","last_became_peered":"2024-04-25 02:06:31.674386","last_unstale":"2024-04-25 02:06:31.676828","last_undegraded":"2024-04-25 02:06:31.676828","last_fullsized":"2024-04-25 02:06:31.676828","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"24'1","reported_seq":"11","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.658614","last_change":"2024-04-25 02:06:31.299750","last_active":"2024-04-25 02:06:31.658614","last_peered":"2024-04-25 02:06:31.658614","last_clean":"2024-04-25 02:06:31.658614","last_became_active":"2024-04-25 02:06:31.299454","last_became_peered":"2024-04-25 02:06:31.299454","last_unstale":"2024-04-25 02:06:31.658614","last_undegraded":"2024-04-25 02:06:31.658614","last_fullsized":"2024-04-25 02:06:31.658614","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.681479","last_change":"2024-04-25 02:06:31.678191","last_active":"2024-04-25 02:06:31.681479","last_peered":"2024-04-25 02:06:31.681479","last_clean":"2024-04-25 02:06:31.681479","last_became_active":"2024-04-25 02:06:31.676365","last_became_peered":"2024-04-25 02:06:31.676365","last_unstale":"2024-04-25 02:06:31.681479","last_undegraded":"2024-04-25 02:06:31.681479","last_fullsized":"2024-04-25 02:06:31.681479","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.641687","last_change":"2024-04-25 02:06:31.302971","last_active":"2024-04-25 02:06:31.641687","last_peered":"2024-04-25 02:06:31.641687","last_clean":"2024-04-25 02:06:31.641687","last_became_active":"2024-04-25 02:06:31.302619","last_became_peered":"2024-04-25 02:06:31.302619","last_unstale":"2024-04-25 02:06:31.641687","last_undegraded":"2024-04-25 02:06:31.641687","last_fullsized":"2024-04-25 02:06:31.641687","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661626","last_change":"2024-04-25 02:06:31.656383","last_active":"2024-04-25 02:06:31.661626","last_peered":"2024-04-25 02:06:31.661626","last_clean":"2024-04-25 02:06:31.661626","last_became_active":"2024-04-25 02:06:31.656069","last_became_peered":"2024-04-25 02:06:31.656069","last_unstale":"2024-04-25 02:06:31.661626","last_undegraded":"2024-04-25 02:06:31.661626","last_fullsized":"2024-04-25 02:06:31.661626","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.648980","last_change":"2024-04-25 02:06:31.319933","last_active":"2024-04-25 02:06:31.648980","last_peered":"2024-04-25 02:06:31.648980","last_clean":"2024-04-25 02:06:31.648980","last_became_active":"2024-04-25 02:06:31.319588","last_became_peered":"2024-04-25 02:06:31.319588","last_unstale":"2024-04-25 02:06:31.648980","last_undegraded":"2024-04-25 02:06:31.648980","last_fullsized":"2024-04-25 02:06:31.648980","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.661369","last_change":"2024-04-25 02:06:31.659321","last_active":"2024-04-25 02:06:31.661369","last_peered":"2024-04-25 02:06:31.661369","last_clean":"2024-04-25 02:06:31.661369","last_became_active":"2024-04-25 02:06:31.658981","last_became_peered":"2024-04-25 02:06:31.658981","last_unstale":"2024-04-25 02:06:31.661369","last_undegraded":"2024-04-25 02:06:31.661369","last_fullsized":"2024-04-25 02:06:31.661369","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.646678","last_change":"2024-04-25 02:06:31.320540","last_active":"2024-04-25 02:06:31.646678","last_peered":"2024-04-25 02:06:31.646678","last_clean":"2024-04-25 02:06:31.646678","last_became_active":"2024-04-25 02:06:31.319304","last_became_peered":"2024-04-25 02:06:31.319304","last_unstale":"2024-04-25 02:06:31.646678","last_undegraded":"2024-04-25 02:06:31.646678","last_fullsized":"2024-04-25 02:06:31.646678","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.673676","last_change":"2024-04-25 02:06:31.668083","last_active":"2024-04-25 02:06:31.673676","last_peered":"2024-04-25 02:06:31.673676","last_clean":"2024-04-25 02:06:31.673676","last_became_active":"2024-04-25 02:06:31.666009","last_became_peered":"2024-04-25 02:06:31.666009","last_unstale":"2024-04-25 02:06:31.673676","last_undegraded":"2024-04-25 02:06:31.673676","last_fullsized":"2024-04-25 02:06:31.673676","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.646776","last_change":"2024-04-25 02:06:31.320725","last_active":"2024-04-25 02:06:31.646776","last_peered":"2024-04-25 02:06:31.646776","last_clean":"2024-04-25 02:06:31.646776","last_became_active":"2024-04-25 02:06:31.320228","last_became_peered":"2024-04-25 02:06:31.320228","last_unstale":"2024-04-25 02:06:31.646776","last_undegraded":"2024-04-25 02:06:31.646776","last_fullsized":"2024-04-25 02:06:31.646776","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.640956","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:31.640956","last_peered":"2024-04-25 02:06:31.640956","last_clean":"2024-04-25 02:06:31.640956","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:31.640956","last_undegraded":"2024-04-25 02:06:31.640956","last_fullsized":"2024-04-25 02:06:31.640956","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.678503","last_change":"2024-04-25 02:06:31.669159","last_active":"2024-04-25 02:06:31.678503","last_peered":"2024-04-25 02:06:31.678503","last_clean":"2024-04-25 02:06:31.678503","last_became_active":"2024-04-25 02:06:31.668845","last_became_peered":"2024-04-25 02:06:31.668845","last_unstale":"2024-04-25 02:06:31.678503","last_undegraded":"2024-04-25 02:06:31.678503","last_fullsized":"2024-04-25 02:06:31.678503","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.640974","last_change":"2024-04-25 02:06:31.303224","last_active":"2024-04-25 02:06:31.640974","last_peered":"2024-04-25 02:06:31.640974","last_clean":"2024-04-25 02:06:31.640974","last_became_active":"2024-04-25 02:06:31.302894","last_became_peered":"2024-04-25 02:06:31.302894","last_unstale":"2024-04-25 02:06:31.640974","last_undegraded":"2024-04-25 02:06:31.640974","last_fullsized":"2024-04-25 02:06:31.640974","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.662350","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:31.662350","last_peered":"2024-04-25 02:06:31.662350","last_clean":"2024-04-25 02:06:31.662350","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:31.662350","last_undegraded":"2024-04-25 02:06:31.662350","last_fullsized":"2024-04-25 02:06:31.662350","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.687454","last_change":"2024-04-25 02:06:31.682919","last_active":"2024-04-25 02:06:31.687454","last_peered":"2024-04-25 02:06:31.687454","last_clean":"2024-04-25 02:06:31.687454","last_became_active":"2024-04-25 02:06:31.682602","last_became_peered":"2024-04-25 02:06:31.682602","last_unstale":"2024-04-25 02:06:31.687454","last_undegraded":"2024-04-25 02:06:31.687454","last_fullsized":"2024-04-25 02:06:31.687454","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.650768","last_change":"2024-04-25 02:06:31.298556","last_active":"2024-04-25 02:06:31.650768","last_peered":"2024-04-25 02:06:31.650768","last_clean":"2024-04-25 02:06:31.650768","last_became_active":"2024-04-25 02:06:31.298019","last_became_peered":"2024-04-25 02:06:31.298019","last_unstale":"2024-04-25 02:06:31.650768","last_undegraded":"2024-04-25 02:06:31.650768","last_fullsized":"2024-04-25 02:06:31.650768","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.647812","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:31.647812","last_peered":"2024-04-25 02:06:31.647812","last_clean":"2024-04-25 02:06:31.647812","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:31.647812","last_undegraded":"2024-04-25 02:06:31.647812","last_fullsized":"2024-04-25 02:06:31.647812","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.675961","last_change":"2024-04-25 02:06:31.673888","last_active":"2024-04-25 02:06:31.675961","last_peered":"2024-04-25 02:06:31.675961","last_clean":"2024-04-25 02:06:31.675961","last_became_active":"2024-04-25 02:06:31.673594","last_became_peered":"2024-04-25 02:06:31.673594","last_unstale":"2024-04-25 02:06:31.675961","last_undegraded":"2024-04-25 02:06:31.675961","last_fullsized":"2024-04-25 02:06:31.675961","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.668278","last_change":"2024-04-25 02:06:31.295065","last_active":"2024-04-25 02:06:31.668278","last_peered":"2024-04-25 02:06:31.668278","last_clean":"2024-04-25 02:06:31.668278","last_became_active":"2024-04-25 02:06:31.294726","last_became_peered":"2024-04-25 02:06:31.294726","last_unstale":"2024-04-25 02:06:31.668278","last_undegraded":"2024-04-25 02:06:31.668278","last_fullsized":"2024-04-25 02:06:31.668278","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.646659","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:31.646659","last_peered":"2024-04-25 02:06:31.646659","last_clean":"2024-04-25 02:06:31.646659","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:31.646659","last_undegraded":"2024-04-25 02:06:31.646659","last_fullsized":"2024-04-25 02:06:31.646659","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680334","last_change":"2024-04-25 02:06:31.674070","last_active":"2024-04-25 02:06:31.680334","last_peered":"2024-04-25 02:06:31.680334","last_clean":"2024-04-25 02:06:31.680334","last_became_active":"2024-04-25 02:06:31.673819","last_became_peered":"2024-04-25 02:06:31.673819","last_unstale":"2024-04-25 02:06:31.680334","last_undegraded":"2024-04-25 02:06:31.680334","last_fullsized":"2024-04-25 02:06:31.680334","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.666721","last_change":"2024-04-25 02:06:31.321195","last_active":"2024-04-25 02:06:31.666721","last_peered":"2024-04-25 02:06:31.666721","last_clean":"2024-04-25 02:06:31.666721","last_became_active":"2024-04-25 02:06:31.320178","last_became_peered":"2024-04-25 02:06:31.320178","last_unstale":"2024-04-25 02:06:31.666721","last_undegraded":"2024-04-25 02:06:31.666721","last_fullsized":"2024-04-25 02:06:31.666721","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.649784","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:31.649784","last_peered":"2024-04-25 02:06:31.649784","last_clean":"2024-04-25 02:06:31.649784","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:31.649784","last_undegraded":"2024-04-25 02:06:31.649784","last_fullsized":"2024-04-25 02:06:31.649784","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.666757","last_change":"2024-04-25 02:06:31.658791","last_active":"2024-04-25 02:06:31.666757","last_peered":"2024-04-25 02:06:31.666757","last_clean":"2024-04-25 02:06:31.666757","last_became_active":"2024-04-25 02:06:31.658454","last_became_peered":"2024-04-25 02:06:31.658454","last_unstale":"2024-04-25 02:06:31.666757","last_undegraded":"2024-04-25 02:06:31.666757","last_fullsized":"2024-04-25 02:06:31.666757","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.648767","last_change":"2024-04-25 02:06:31.301619","last_active":"2024-04-25 02:06:31.648767","last_peered":"2024-04-25 02:06:31.648767","last_clean":"2024-04-25 02:06:31.648767","last_became_active":"2024-04-25 02:06:31.301032","last_became_peered":"2024-04-25 02:06:31.301032","last_unstale":"2024-04-25 02:06:31.648767","last_undegraded":"2024-04-25 02:06:31.648767","last_fullsized":"2024-04-25 02:06:31.648767","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.645651","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:31.645651","last_peered":"2024-04-25 02:06:31.645651","last_clean":"2024-04-25 02:06:31.645651","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:31.645651","last_undegraded":"2024-04-25 02:06:31.645651","last_fullsized":"2024-04-25 02:06:31.645651","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.680355","last_change":"2024-04-25 02:06:31.673719","last_active":"2024-04-25 02:06:31.680355","last_peered":"2024-04-25 02:06:31.680355","last_clean":"2024-04-25 02:06:31.680355","last_became_active":"2024-04-25 02:06:31.673405","last_became_peered":"2024-04-25 02:06:31.673405","last_unstale":"2024-04-25 02:06:31.680355","last_undegraded":"2024-04-25 02:06:31.680355","last_fullsized":"2024-04-25 02:06:31.680355","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.649507","last_change":"2024-04-25 02:06:31.299729","last_active":"2024-04-25 02:06:31.649507","last_peered":"2024-04-25 02:06:31.649507","last_clean":"2024-04-25 02:06:31.649507","last_became_active":"2024-04-25 02:06:31.299339","last_became_peered":"2024-04-25 02:06:31.299339","last_unstale":"2024-04-25 02:06:31.649507","last_undegraded":"2024-04-25 02:06:31.649507","last_fullsized":"2024-04-25 02:06:31.649507","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.668094","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:31.668094","last_peered":"2024-04-25 02:06:31.668094","last_clean":"2024-04-25 02:06:31.668094","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:31.668094","last_undegraded":"2024-04-25 02:06:31.668094","last_fullsized":"2024-04-25 02:06:31.668094","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"9","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.675202","last_change":"2024-04-25 02:06:31.666104","last_active":"2024-04-25 02:06:31.675202","last_peered":"2024-04-25 02:06:31.675202","last_clean":"2024-04-25 02:06:31.675202","last_became_active":"2024-04-25 02:06:31.665599","last_became_peered":"2024-04-25 02:06:31.665599","last_unstale":"2024-04-25 02:06:31.675202","last_undegraded":"2024-04-25 02:06:31.675202","last_fullsized":"2024-04-25 02:06:31.675202","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:31.247756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:31.247756","last_clean_scrub_stamp":"2024-04-25 02:06:31.247756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.647878","last_change":"2024-04-25 02:06:31.301247","last_active":"2024-04-25 02:06:31.647878","last_peered":"2024-04-25 02:06:31.647878","last_clean":"2024-04-25 02:06:31.647878","last_became_active":"2024-04-25 02:06:31.300901","last_became_peered":"2024-04-25 02:06:31.300901","last_unstale":"2024-04-25 02:06:31.647878","last_undegraded":"2024-04-25 02:06:31.647878","last_fullsized":"2024-04-25 02:06:31.647878","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:30.241589","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:30.241589","last_clean_scrub_stamp":"2024-04-25 02:06:30.241589","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2024-04-25 02:06:31.654508","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:31.654508","last_peered":"2024-04-25 02:06:31.654508","last_clean":"2024-04-25 02:06:31.654508","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:31.654508","last_undegraded":"2024-04-25 02:06:31.654508","last_fullsized":"2024-04-25 02:06:31.654508","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705678,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":72360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705679,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":71614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]}]},{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048804,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323036,"statfs":{"total":96636764160,"available":95562788864,"internally_reserved":1073741824,"allocated":225280,"data_stored":70164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705679,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":70730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]}]}} 2024-04-25T02:06:39.255 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:06:39.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.421 7fe6589dc700 1 Processor -- start 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.421 7fe6589dc700 1 -- start start 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.421 7fe6589dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6540f5a10 0x7fe65410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.421 7fe6589dc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe65410b740 0x7fe65419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.421 7fe6589dc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe65410bb90 0x7fe6541a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.421 7fe6589dc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6540fa590 con 0x7fe6540f5a10 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.421 7fe6589dc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541a08a0 con 0x7fe65410b740 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.421 7fe6589dc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541a0ad0 con 0x7fe65410bb90 2024-04-25T02:06:39.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe650dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe65410b740 0x7fe65419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe651dfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe65410bb90 0x7fe6541a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe6515fb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6540f5a10 0x7fe65410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe650dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe65410b740 0x7fe65419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49902/0 (socket says 172.21.15.57:49902) 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe650dfa700 1 -- 172.21.15.57:0/3082159149 learned_addr learned my addr 172.21.15.57:0/3082159149 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe651dfc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe65410bb90 0x7fe6541a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48822/0 (socket says 172.21.15.57:48822) 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe651dfc700 1 -- 172.21.15.57:0/3082159149 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe65410b740 msgr2=0x7fe65419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe651dfc700 1 --2- 172.21.15.57:0/3082159149 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe65410b740 0x7fe65419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe651dfc700 1 -- 172.21.15.57:0/3082159149 >> v2:172.21.15.57:3300/0 conn(0x7fe6540f5a10 msgr2=0x7fe65410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe651dfc700 1 --2- 172.21.15.57:0/3082159149 >> v2:172.21.15.57:3300/0 conn(0x7fe6540f5a10 0x7fe65410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe651dfc700 1 -- 172.21.15.57:0/3082159149 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6541a73b0 con 0x7fe65410bb90 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe650dfa700 1 --2- 172.21.15.57:0/3082159149 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe65410b740 0x7fe65419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe6515fb700 1 --2- 172.21.15.57:0/3082159149 >> v2:172.21.15.57:3300/0 conn(0x7fe6540f5a10 0x7fe65410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:39.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe651dfc700 1 --2- 172.21.15.57:0/3082159149 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe65410bb90 0x7fe6541a0270 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe6540f47c0 tx=0x7fe64c009cc0).ready entity=mon.2 client_cookie=906286e72785936b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe643fff700 1 -- 172.21.15.57:0/3082159149 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6541a73b0 con 0x7fe65410bb90 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe643fff700 1 -- 172.21.15.57:0/3082159149 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c00b840 con 0x7fe65410bb90 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe643fff700 1 -- 172.21.15.57:0/3082159149 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe64c00ba20 con 0x7fe65410bb90 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe6589dc700 1 -- 172.21.15.57:0/3082159149 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe65410bb90 msgr2=0x7fe6541a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.422 7fe6589dc700 1 --2- 172.21.15.57:0/3082159149 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe65410bb90 0x7fe6541a0270 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe6540f47c0 tx=0x7fe64c009cc0).stop 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.423 7fe6589dc700 1 -- 172.21.15.57:0/3082159149 shutdown_connections 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.423 7fe6589dc700 1 --2- 172.21.15.57:0/3082159149 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe65410bb90 0x7fe6541a0270 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.423 7fe6589dc700 1 --2- 172.21.15.57:0/3082159149 >> v2:172.21.15.57:3300/0 conn(0x7fe6540f5a10 0x7fe65410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.423 7fe6589dc700 1 --2- 172.21.15.57:0/3082159149 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe65410b740 0x7fe65419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.423 7fe6589dc700 1 -- 172.21.15.57:0/3082159149 >> 172.21.15.57:0/3082159149 conn(0x7fe654113a70 msgr2=0x7fe6540f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.423 7fe6589dc700 1 -- 172.21.15.57:0/3082159149 shutdown_connections 2024-04-25T02:06:39.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.423 7fe6589dc700 1 -- 172.21.15.57:0/3082159149 wait complete. 2024-04-25T02:06:39.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.447 7fe6589dc700 1 Processor -- start 2024-04-25T02:06:39.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.447 7fe6589dc700 1 -- start start 2024-04-25T02:06:39.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6589dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6540d5010 0x7fe6540d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6589dc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6540d5a90 0x7fe6541afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6589dc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6541b0320 0x7fe6541b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6589dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540efcb0 con 0x7fe6540d5010 2024-04-25T02:06:39.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6589dc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6540cc920 con 0x7fe6540d5a90 2024-04-25T02:06:39.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6589dc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541b0da0 con 0x7fe6541b0320 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6540d5010 0x7fe6540d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe650dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6540d5a90 0x7fe6541afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6540d5010 0x7fe6540d5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49022/0 (socket says 172.21.15.57:49022) 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 -- 172.21.15.57:0/3370901771 learned_addr learned my addr 172.21.15.57:0/3370901771 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe651dfc700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6541b0320 0x7fe6541b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 -- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6541b0320 msgr2=0x7fe6541b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6541b0320 0x7fe6541b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 -- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6540d5a90 msgr2=0x7fe6541afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6540d5a90 0x7fe6541afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 -- 172.21.15.57:0/3370901771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540cd1e0 con 0x7fe6540d5010 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe650dfa700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6540d5a90 0x7fe6541afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6515fb700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6540d5010 0x7fe6540d5460 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fe6540c3e60 tx=0x7fe64400ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6427fc700 1 -- 172.21.15.57:0/3370901771 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6540cd1e0 con 0x7fe6540d5010 2024-04-25T02:06:39.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6427fc700 1 -- 172.21.15.57:0/3370901771 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64400c940 con 0x7fe6540d5010 2024-04-25T02:06:39.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6427fc700 1 -- 172.21.15.57:0/3370901771 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe64400f040 con 0x7fe6540d5010 2024-04-25T02:06:39.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.448 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6540c7c80 con 0x7fe6540d5010 2024-04-25T02:06:39.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.449 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6540c82b0 con 0x7fe6540d5010 2024-04-25T02:06:39.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.449 7fe6427fc700 1 -- 172.21.15.57:0/3370901771 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe644011070 con 0x7fe6540d5010 2024-04-25T02:06:39.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.449 7fe6427fc700 1 -- 172.21.15.57:0/3370901771 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe644010040 con 0x7fe6540d5010 2024-04-25T02:06:39.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.450 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6541aa410 con 0x7fe6540d5010 2024-04-25T02:06:39.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.453 7fe6427fc700 1 -- 172.21.15.57:0/3370901771 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe64400c540 con 0x7fe6540d5010 2024-04-25T02:06:39.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.598 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe6540e2430 con 0x7fe6540d5010 2024-04-25T02:06:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.605 7fe6427fc700 1 -- 172.21.15.57:0/3370901771 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe644000c30 con 0x7fe6540d5010 2024-04-25T02:06:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 >> v1:172.21.15.57:6816/43033 conn(0x7fe6300145b0 legacy=0x7fe630016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6540d5010 msgr2=0x7fe6540d5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6540d5010 0x7fe6540d5460 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fe6540c3e60 tx=0x7fe64400ed00).stop 2024-04-25T02:06:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 shutdown_connections 2024-04-25T02:06:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6541b0320 0x7fe6541b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6540d5010 0x7fe6540d5460 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 --2- 172.21.15.57:0/3370901771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6540d5a90 0x7fe6541afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 >> 172.21.15.57:0/3370901771 conn(0x7fe6540c8e60 msgr2=0x7fe6540df7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 shutdown_connections 2024-04-25T02:06:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.606 7fe6589dc700 1 -- 172.21.15.57:0/3370901771 wait complete. 2024-04-25T02:06:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2024-04-25T02:06:39.624 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7cabdba700 1 Processor -- start 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7cabdba700 1 -- start start 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7cabdba700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40f5920 0x7f7ca40f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7cabdba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40f1ec0 0x7f7ca410e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7cabdba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ca40f2310 0x7f7ca410e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7cabdba700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca40f9230 con 0x7f7ca40f2310 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7cabdba700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca410ef10 con 0x7f7ca40f5920 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7cabdba700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41aa660 con 0x7f7ca40f1ec0 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7ca93b6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ca40f2310 0x7f7ca410e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7ca3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40f1ec0 0x7f7ca410e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7ca8bb5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40f5920 0x7f7ca40f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7ca93b6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ca40f2310 0x7f7ca410e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49034/0 (socket says 172.21.15.57:49034) 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7ca93b6700 1 -- 172.21.15.57:0/4219481276 learned_addr learned my addr 172.21.15.57:0/4219481276 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7ca3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40f1ec0 0x7f7ca410e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48830/0 (socket says 172.21.15.57:48830) 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.750 7f7ca8bb5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40f5920 0x7f7ca40f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49922/0 (socket says 172.21.15.57:49922) 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca3fff700 1 -- 172.21.15.57:0/4219481276 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40f5920 msgr2=0x7f7ca40f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca3fff700 1 --2- 172.21.15.57:0/4219481276 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40f5920 0x7f7ca40f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca3fff700 1 -- 172.21.15.57:0/4219481276 >> v2:172.21.15.57:3300/0 conn(0x7f7ca40f2310 msgr2=0x7f7ca410e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca3fff700 1 --2- 172.21.15.57:0/4219481276 >> v2:172.21.15.57:3300/0 conn(0x7f7ca40f2310 0x7f7ca410e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca3fff700 1 -- 172.21.15.57:0/4219481276 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca41aa810 con 0x7f7ca40f1ec0 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca93b6700 1 --2- 172.21.15.57:0/4219481276 >> v2:172.21.15.57:3300/0 conn(0x7f7ca40f2310 0x7f7ca410e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca3fff700 1 --2- 172.21.15.57:0/4219481276 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40f1ec0 0x7f7ca410e2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7c8c002f70 tx=0x7f7c8c00b970).ready entity=mon.2 client_cookie=a699cbdadbc874bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca37fe700 1 -- 172.21.15.57:0/4219481276 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ca41aa810 con 0x7f7ca40f1ec0 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca37fe700 1 -- 172.21.15.57:0/4219481276 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00d570 con 0x7f7ca40f1ec0 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7ca37fe700 1 -- 172.21.15.57:0/4219481276 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c8c00d940 con 0x7f7ca40f1ec0 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7cabdba700 1 -- 172.21.15.57:0/4219481276 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40f1ec0 msgr2=0x7f7ca410e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.751 7f7cabdba700 1 --2- 172.21.15.57:0/4219481276 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40f1ec0 0x7f7ca410e2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7c8c002f70 tx=0x7f7c8c00b970).stop 2024-04-25T02:06:39.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.752 7f7cabdba700 1 -- 172.21.15.57:0/4219481276 shutdown_connections 2024-04-25T02:06:39.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.752 7f7cabdba700 1 --2- 172.21.15.57:0/4219481276 >> v2:172.21.15.57:3300/0 conn(0x7f7ca40f2310 0x7f7ca410e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.752 7f7cabdba700 1 --2- 172.21.15.57:0/4219481276 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40f5920 0x7f7ca40f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.752 7f7cabdba700 1 --2- 172.21.15.57:0/4219481276 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40f1ec0 0x7f7ca410e2b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.752 7f7cabdba700 1 -- 172.21.15.57:0/4219481276 >> 172.21.15.57:0/4219481276 conn(0x7f7ca4113a70 msgr2=0x7f7ca40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.752 7f7cabdba700 1 -- 172.21.15.57:0/4219481276 shutdown_connections 2024-04-25T02:06:39.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.752 7f7cabdba700 1 -- 172.21.15.57:0/4219481276 wait complete. 2024-04-25T02:06:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7cabdba700 1 Processor -- start 2024-04-25T02:06:39.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7cabdba700 1 -- start start 2024-04-25T02:06:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7cabdba700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40bd480 0x7f7ca40ded20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7cabdba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40df350 0x7f7ca40d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7cabdba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ca40df7a0 0x7f7ca40d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:39.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7cabdba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40e09c0 con 0x7f7ca40df7a0 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7cabdba700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40d4220 con 0x7f7ca40bd480 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7cabdba700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41bb910 con 0x7f7ca40df350 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7ca3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40df350 0x7f7ca40d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7ca93b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ca40df7a0 0x7f7ca40d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7ca8bb5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40bd480 0x7f7ca40ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7ca3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40df350 0x7f7ca40d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48836/0 (socket says 172.21.15.57:48836) 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7ca93b6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ca40df7a0 0x7f7ca40d3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49044/0 (socket says 172.21.15.57:49044) 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7ca8bb5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40bd480 0x7f7ca40ded20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49932/0 (socket says 172.21.15.57:49932) 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.776 7f7ca3fff700 1 -- 172.21.15.57:0/1581044855 learned_addr learned my addr 172.21.15.57:0/1581044855 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca8bb5700 1 -- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40df350 msgr2=0x7f7ca40d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca8bb5700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40df350 0x7f7ca40d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca8bb5700 1 -- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ca40df7a0 msgr2=0x7f7ca40d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca8bb5700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ca40df7a0 0x7f7ca40d3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca8bb5700 1 -- 172.21.15.57:0/1581044855 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca41bbac0 con 0x7f7ca40bd480 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca93b6700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ca40df7a0 0x7f7ca40d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca3fff700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40df350 0x7f7ca40d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca8bb5700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40bd480 0x7f7ca40ded20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7ca40e01e0 tx=0x7f7c9400ec50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca1ffb700 1 -- 172.21.15.57:0/1581044855 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ca41bbac0 con 0x7f7ca40bd480 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca1ffb700 1 -- 172.21.15.57:0/1581044855 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400c9a0 con 0x7f7ca40bd480 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca1ffb700 1 -- 172.21.15.57:0/1581044855 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c9400f040 con 0x7f7ca40bd480 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca41bbcc0 con 0x7f7ca40bd480 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca41bc0a0 con 0x7f7ca40bd480 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.777 7f7ca1ffb700 1 -- 172.21.15.57:0/1581044855 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7c94011070 con 0x7f7ca40bd480 2024-04-25T02:06:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.778 7f7ca1ffb700 1 -- 172.21.15.57:0/1581044855 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f7c94010040 con 0x7f7ca40bd480 2024-04-25T02:06:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.778 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca40d4450 con 0x7f7ca40bd480 2024-04-25T02:06:39.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.781 7f7ca1ffb700 1 -- 172.21.15.57:0/1581044855 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f7c9400c5a0 con 0x7f7ca40bd480 2024-04-25T02:06:39.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.926 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ca40f08e0 con 0x7f7ca40bd480 2024-04-25T02:06:39.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.926 7f7ca1ffb700 1 -- 172.21.15.57:0/1581044855 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1700 (secure 0 0 0) 0x7f7c94000c30 con 0x7f7ca40bd480 2024-04-25T02:06:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:39.933 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:06:31.632273","modified":"2024-04-25 02:06:33.665250","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4684":{"gid":4684,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6817/32905363","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":32905363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.927 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 >> v1:172.21.15.57:6816/43033 conn(0x7f7c880145b0 legacy=0x7f7c88016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.927 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40bd480 msgr2=0x7f7ca40ded20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.928 7f7cabdba700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40bd480 0x7f7ca40ded20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7ca40e01e0 tx=0x7f7c9400ec50).stop 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.928 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 shutdown_connections 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.928 7f7cabdba700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ca40df7a0 0x7f7ca40d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.928 7f7cabdba700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ca40bd480 0x7f7ca40ded20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.928 7f7cabdba700 1 --2- 172.21.15.57:0/1581044855 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ca40df350 0x7f7ca40d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.928 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 >> 172.21.15.57:0/1581044855 conn(0x7f7ca40de270 msgr2=0x7f7ca40c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.928 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 shutdown_connections 2024-04-25T02:06:39.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:39.928 7f7cabdba700 1 -- 172.21.15.57:0/1581044855 wait complete. 2024-04-25T02:06:39.936 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 11 2024-04-25T02:06:40.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25 02:06:31.632273', 'modified': '2024-04-25 02:06:33.665250', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4684}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4684': {'gid': 4684, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6817/32905363', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6817', 'nonce': 32905363}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:06:40.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:06:40.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T02:06:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.173 7f18f4c88700 1 Processor -- start 2024-04-25T02:06:40.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.173 7f18f4c88700 1 -- start start 2024-04-25T02:06:40.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18f4c88700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18f00f5980 0x7f18f010b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18f4c88700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f010b6b0 0x7f18f019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18f4c88700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f010bb00 0x7f18f01a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18f4c88700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f00fa500 con 0x7f18f00f5980 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18f4c88700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f01a0810 con 0x7f18f010b6b0 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18f4c88700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f01a0a40 con 0x7f18f010bb00 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18eda63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18f00f5980 0x7f18f010b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ee264700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f010bb00 0x7f18f01a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ed262700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f010b6b0 0x7f18f019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ee264700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f010bb00 0x7f18f01a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48838/0 (socket says 172.21.15.57:48838) 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18eda63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18f00f5980 0x7f18f010b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49046/0 (socket says 172.21.15.57:49046) 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ee264700 1 -- 172.21.15.57:0/830406138 learned_addr learned my addr 172.21.15.57:0/830406138 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ed262700 1 -- 172.21.15.57:0/830406138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f010bb00 msgr2=0x7f18f01a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ed262700 1 --2- 172.21.15.57:0/830406138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f010bb00 0x7f18f01a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ed262700 1 -- 172.21.15.57:0/830406138 >> v2:172.21.15.57:3300/0 conn(0x7f18f00f5980 msgr2=0x7f18f010b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ed262700 1 --2- 172.21.15.57:0/830406138 >> v2:172.21.15.57:3300/0 conn(0x7f18f00f5980 0x7f18f010b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ed262700 1 -- 172.21.15.57:0/830406138 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f01a7320 con 0x7f18f010b6b0 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18eda63700 1 --2- 172.21.15.57:0/830406138 >> v2:172.21.15.57:3300/0 conn(0x7f18f00f5980 0x7f18f010b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18ed262700 1 --2- 172.21.15.57:0/830406138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f010b6b0 0x7f18f019fbb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f18f00f4730 tx=0x7f18d800ba20).ready entity=mon.1 client_cookie=14e84d926ad8baf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18eca61700 1 -- 172.21.15.57:0/830406138 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18f01a7320 con 0x7f18f010b6b0 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18eca61700 1 -- 172.21.15.57:0/830406138 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800d570 con 0x7f18f010b6b0 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18eca61700 1 -- 172.21.15.57:0/830406138 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18d800d940 con 0x7f18f010b6b0 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18f4c88700 1 -- 172.21.15.57:0/830406138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f010b6b0 msgr2=0x7f18f019fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.174 7f18f4c88700 1 --2- 172.21.15.57:0/830406138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f010b6b0 0x7f18f019fbb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f18f00f4730 tx=0x7f18d800ba20).stop 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.175 7f18f4c88700 1 -- 172.21.15.57:0/830406138 shutdown_connections 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.175 7f18f4c88700 1 --2- 172.21.15.57:0/830406138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f010bb00 0x7f18f01a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.175 7f18f4c88700 1 --2- 172.21.15.57:0/830406138 >> v2:172.21.15.57:3300/0 conn(0x7f18f00f5980 0x7f18f010b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.175 7f18f4c88700 1 --2- 172.21.15.57:0/830406138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f010b6b0 0x7f18f019fbb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.175 7f18f4c88700 1 -- 172.21.15.57:0/830406138 >> 172.21.15.57:0/830406138 conn(0x7f18f01139e0 msgr2=0x7f18f00f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.175 7f18f4c88700 1 -- 172.21.15.57:0/830406138 shutdown_connections 2024-04-25T02:06:40.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.175 7f18f4c88700 1 -- 172.21.15.57:0/830406138 wait complete. 2024-04-25T02:06:40.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18f4c88700 1 Processor -- start 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18f4c88700 1 -- start start 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18f4c88700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f01a1400 0x7f18f00d4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18f4c88700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18f00d4e50 0x7f18f01b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18f4c88700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f00d52a0 0x7f18f01b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18f4c88700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00ddf60 con 0x7f18f00d4e50 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18f4c88700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00de2b0 con 0x7f18f01a1400 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18f4c88700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f01b4e40 con 0x7f18f00d52a0 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18eda63700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f01a1400 0x7f18f00d4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18ed262700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18f00d4e50 0x7f18f01b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18eda63700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f01a1400 0x7f18f00d4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49940/0 (socket says 172.21.15.57:49940) 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18eda63700 1 -- 172.21.15.57:0/1158785011 learned_addr learned my addr 172.21.15.57:0/1158785011 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.199 7f18ee264700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f00d52a0 0x7f18f01b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18eda63700 1 -- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f00d52a0 msgr2=0x7f18f01b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18eda63700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f00d52a0 0x7f18f01b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18eda63700 1 -- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18f00d4e50 msgr2=0x7f18f01b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18eda63700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18f00d4e50 0x7f18f01b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18eda63700 1 -- 172.21.15.57:0/1158785011 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f01b5070 con 0x7f18f01a1400 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18ed262700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18f00d4e50 0x7f18f01b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18eda63700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f01a1400 0x7f18f00d4820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f18f00c4d20 tx=0x7f18e000ed00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18e6ffd700 1 -- 172.21.15.57:0/1158785011 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18f01b5070 con 0x7f18f01a1400 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18e6ffd700 1 -- 172.21.15.57:0/1158785011 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000c940 con 0x7f18f01a1400 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18e6ffd700 1 -- 172.21.15.57:0/1158785011 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18e000f040 con 0x7f18f01a1400 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18f4c88700 1 -- 172.21.15.57:0/1158785011 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f01bb960 con 0x7f18f01a1400 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.200 7f18f4c88700 1 -- 172.21.15.57:0/1158785011 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f01bbd40 con 0x7f18f01a1400 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.201 7f18e6ffd700 1 -- 172.21.15.57:0/1158785011 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f18e0011070 con 0x7f18f01a1400 2024-04-25T02:06:40.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.201 7f18e6ffd700 1 -- 172.21.15.57:0/1158785011 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f18e0010040 con 0x7f18f01a1400 2024-04-25T02:06:40.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.203 7f1907541b80 1 Processor -- start 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f1907541b80 1 -- start start 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f1907541b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737863220 0x55b737863670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f1907541b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b737863ca0 0x55b7378568e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f1907541b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b737856f10 0x55b737857360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f1907541b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b73778ec80 con 0x55b737863ca0 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f1907541b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7377aca40 con 0x55b737856f10 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f1907541b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b737779e00 con 0x55b737863220 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b737863ca0 0x55b7378568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ee264700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b737856f10 0x55b737857360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b737863ca0 0x55b7378568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49064/0 (socket says 172.21.15.57:49064) 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ee264700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b737856f10 0x55b737857360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49954/0 (socket says 172.21.15.57:49954) 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 -- 172.21.15.57:0/2866966966 learned_addr learned my addr 172.21.15.57:0/2866966966 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18eda63700 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737863220 0x55b737863670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 -- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737863220 msgr2=0x55b737863670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737863220 0x55b737863670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 -- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b737856f10 msgr2=0x55b737857360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b737856f10 0x55b737857360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 -- 172.21.15.57:0/2866966966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b73782c3a0 con 0x55b737863ca0 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ee264700 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b737856f10 0x55b737857360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.204 7f18ed262700 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b737863ca0 0x55b7378568e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x55b73779f4f0 tx=0x7f18d8006830).ready entity=mon.0 client_cookie=2da3f5d31830ba1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f18f4c88700 1 -- 172.21.15.57:0/2866966966 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b73782c3a0 con 0x55b737863ca0 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f18f4c88700 1 -- 172.21.15.57:0/2866966966 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800d9c0 con 0x55b737863ca0 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f18f4c88700 1 -- 172.21.15.57:0/2866966966 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18d8017040 con 0x55b737863ca0 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 -- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b737863ca0 msgr2=0x55b7378568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b737863ca0 0x55b7378568e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x55b73779f4f0 tx=0x7f18d8006830).stop 2024-04-25T02:06:40.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 -- 172.21.15.57:0/2866966966 shutdown_connections 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b737856f10 0x55b737857360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737863220 0x55b737863670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 --2- 172.21.15.57:0/2866966966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b737863ca0 0x55b7378568e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 -- 172.21.15.57:0/2866966966 >> 172.21.15.57:0/2866966966 conn(0x55b73784fcc0 msgr2=0x55b737871200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 -- 172.21.15.57:0/2866966966 shutdown_connections 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.205 7f1907541b80 1 -- 172.21.15.57:0/2866966966 wait complete. 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 1 -- start start 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 1 Processor -- start 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b73787e8a0 0x55b73787ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b73787f320 0x55b737859540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737859b70 0x55b737859fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b73784f500 con 0x55b73787f320 2024-04-25T02:06:40.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b737858e60 con 0x55b73787e8a0 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b737885e10 con 0x55b737859b70 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f1907541b80 10 client.0 ll_register_callbacks cb 0x55b737784d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f18ee264700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737859b70 0x55b737859fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f18ee264700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737859b70 0x55b737859fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48860/0 (socket says 172.21.15.57:48860) 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f18ee264700 1 -- 172.21.15.57:0/4294286565 learned_addr learned my addr 172.21.15.57:0/4294286565 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.206 7f18eda63700 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b73787e8a0 0x55b73787ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ed262700 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b73787f320 0x55b737859540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18eda63700 1 -- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737859b70 msgr2=0x55b737859fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18eda63700 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737859b70 0x55b737859fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18eda63700 1 -- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b73787f320 msgr2=0x55b737859540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18eda63700 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b73787f320 0x55b737859540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18eda63700 1 -- 172.21.15.57:0/4294286565 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b73769cb60 con 0x55b73787e8a0 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ee264700 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737859b70 0x55b737859fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:40.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ed262700 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b73787f320 0x55b737859540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18eda63700 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b73787e8a0 0x55b73787ecf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x55b73784f230 tx=0x7f18e0014430).ready entity=mon.1 client_cookie=d03c38f902934910 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3301/0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ccff9700 1 -- 172.21.15.57:0/4294286565 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b73769cb60 con 0x55b73787e8a0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ccff9700 1 -- 172.21.15.57:0/4294286565 <== mon.1 v2:172.21.15.57:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f18e0018460 con 0x55b73787e8a0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f1907541b80 1 -- 172.21.15.57:0/4294286565 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b737797cd0 con 0x55b73787e8a0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ccff9700 1 -- 172.21.15.57:0/4294286565 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18e0011e30 con 0x55b73787e8a0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f1907541b80 10 client.4852 fetch_fsmap learned FSMap version 11 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f1907541b80 1 -- 172.21.15.57:0/4294286565 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x55b737886490 con 0x55b73787e8a0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ccff9700 1 -- 172.21.15.57:0/4294286565 <== mon.1 v2:172.21.15.57:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b737797cd0 con 0x55b73787e8a0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f18ccff9700 1 -- 172.21.15.57:0/4294286565 <== mon.1 v2:172.21.15.57:3301/0 5 ==== fsmap(e 11) v1 ==== 1025+0+0 (secure 0 0 0) 0x7f18e001b030 con 0x55b73787e8a0 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f1907541b80 10 client.4852 fetch_fsmap finished waiting for FSMap version 11 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f1907541b80 10 client.4852 resolve_mds: resolved ID 'a' to GID 4684 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.207 7f1907541b80 20 client.4852 populate_metadata read hostname 'smithi057' 2024-04-25T02:06:40.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 4 client.4852 mds_command: new command op to 4684 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 -- 172.21.15.57:0/4294286565 --> v1:172.21.15.57:6817/32905363 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b737690ba0 con 0x55b7378868a0 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f18ccff9700 10 client.4852 ms_handle_connect on v1:172.21.15.57:6817/32905363 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f18ccff9700 1 -- 172.21.15.57:0/4294286565 <== mds.0 v1:172.21.15.57:6817/32905363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55b737690ba0 con 0x55b7378868a0 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f18ccff9700 10 client.4852 handle_command_reply: tid=0 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 client.4852 shutdown 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 -- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b73787e8a0 msgr2=0x55b73787ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b73787e8a0 0x55b73787ecf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x55b73784f230 tx=0x7f18e0014430).stop 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 -- 172.21.15.57:0/4294286565 shutdown_connections 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55b737859b70 0x55b737859fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f18ccff9700 0 client.4852 ms_handle_reset on v1:172.21.15.57:6817/32905363 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b73787e8a0 0x55b73787ecf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 --2- 172.21.15.57:0/4294286565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b73787f320 0x55b737859540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.208 7f1907541b80 1 -- 172.21.15.57:0/4294286565 >> 172.21.15.57:0/4294286565 conn(0x55b737871330 msgr2=0x55b7378579e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:40.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.209 7f1907541b80 1 -- 172.21.15.57:0/4294286565 shutdown_connections 2024-04-25T02:06:40.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.209 7f1907541b80 1 -- 172.21.15.57:0/4294286565 wait complete. 2024-04-25T02:06:40.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.209 7f1907541b80 20 client.4852 trim_cache size 0 max 16384 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.218 7f18ceffd700 1 -- 172.21.15.57:0/1158785011 >> v1:172.21.15.57:6816/43033 conn(0x7f18d40145b0 legacy=0x7f18d4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.218 7f18ceffd700 1 -- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f01a1400 msgr2=0x7f18f00d4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.218 7f18ceffd700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f01a1400 0x7f18f00d4820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f18f00c4d20 tx=0x7f18e000ed00).stop 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.219 7f18ceffd700 1 -- 172.21.15.57:0/1158785011 shutdown_connections 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.219 7f18ceffd700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18f00d52a0 0x7f18f01b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.219 7f18ceffd700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18f01a1400 0x7f18f00d4820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.219 7f18ceffd700 1 --2- 172.21.15.57:0/1158785011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18f00d4e50 0x7f18f01b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.219 7f18ceffd700 1 -- 172.21.15.57:0/1158785011 >> 172.21.15.57:0/1158785011 conn(0x7f18f00c3e30 msgr2=0x7f18f00da440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.219 7f18ceffd700 1 -- 172.21.15.57:0/1158785011 shutdown_connections 2024-04-25T02:06:40.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.219 7f18ceffd700 1 -- 172.21.15.57:0/1158785011 wait complete. 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:no valid command found; 10 closest matches: 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:injectargs [...] 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:config set 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:config unset 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:exit 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:respawn 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:session kill 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:cpu_profiler status|flush 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:session ls { [...]} 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:client ls { [...]} 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:session evict { [...]} 2024-04-25T02:06:40.227 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: invalid command 2024-04-25T02:06:40.236 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T02:06:40.236 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:06:40.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a45c11700 1 Processor -- start 2024-04-25T02:06:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a45c11700 1 -- start start 2024-04-25T02:06:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a45c11700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a401a30e0 0x7f3a401a5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a45c11700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a401a5b70 0x7f3a401a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a45c11700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a40110ea0 con 0x7f3a400f3660 2024-04-25T02:06:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a45c11700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a40105920 con 0x7f3a401a30e0 2024-04-25T02:06:40.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a45c11700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40103c00 con 0x7f3a401a5b70 2024-04-25T02:06:40.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a3e05c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a401a30e0 0x7f3a401a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a3f05e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a401a5b70 0x7f3a401a7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a3e85d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3a400f3660 0x7f3a400fe400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47700/0 (socket says 172.21.15.57:47700) 2024-04-25T02:06:40.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.361 7f3a3e85d700 1 -- 172.21.15.57:0/3965332592 learned_addr learned my addr 172.21.15.57:0/3965332592 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:40.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3d85b700 1 -- 172.21.15.57:0/3965332592 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431338362 0 0) 0x7f3a30001110 con 0x7f3a400f3660 2024-04-25T02:06:40.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3d85b700 1 -- 172.21.15.57:0/3965332592 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a24003270 con 0x7f3a400f3660 2024-04-25T02:06:40.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3f05e700 1 -- 172.21.15.57:0/3965332592 >> v2:172.21.15.57:3300/0 conn(0x7f3a401a30e0 msgr2=0x7f3a401a5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:40.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3f05e700 1 --2- 172.21.15.57:0/3965332592 >> v2:172.21.15.57:3300/0 conn(0x7f3a401a30e0 0x7f3a401a5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3f05e700 1 -- 172.21.15.57:0/3965332592 >> v1:172.21.15.57:6789/0 conn(0x7f3a400f3660 legacy=0x7f3a400fe400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3f05e700 1 -- 172.21.15.57:0/3965332592 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400fec00 con 0x7f3a401a5b70 2024-04-25T02:06:40.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3e05c700 1 --2- 172.21.15.57:0/3965332592 >> v2:172.21.15.57:3300/0 conn(0x7f3a401a30e0 0x7f3a401a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:40.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3f05e700 1 --2- 172.21.15.57:0/3965332592 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a401a5b70 0x7f3a401a7fd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3a400f47d0 tx=0x7f3a38009cc0).ready entity=mon.2 client_cookie=2d91628511713b7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:40.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3d85b700 1 -- 172.21.15.57:0/3965332592 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a400fec00 con 0x7f3a401a5b70 2024-04-25T02:06:40.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3d85b700 1 -- 172.21.15.57:0/3965332592 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800b840 con 0x7f3a401a5b70 2024-04-25T02:06:40.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a3d85b700 1 -- 172.21.15.57:0/3965332592 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a3800ba20 con 0x7f3a401a5b70 2024-04-25T02:06:40.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a45c11700 1 -- 172.21.15.57:0/3965332592 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a401a5b70 msgr2=0x7f3a401a7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.362 7f3a45c11700 1 --2- 172.21.15.57:0/3965332592 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a401a5b70 0x7f3a401a7fd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3a400f47d0 tx=0x7f3a38009cc0).stop 2024-04-25T02:06:40.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.363 7f3a45c11700 1 -- 172.21.15.57:0/3965332592 shutdown_connections 2024-04-25T02:06:40.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.363 7f3a45c11700 1 --2- 172.21.15.57:0/3965332592 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a401a5b70 0x7f3a401a7fd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.363 7f3a45c11700 1 --2- 172.21.15.57:0/3965332592 >> v2:172.21.15.57:3300/0 conn(0x7f3a401a30e0 0x7f3a401a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.363 7f3a45c11700 1 -- 172.21.15.57:0/3965332592 >> 172.21.15.57:0/3965332592 conn(0x7f3a40113a80 msgr2=0x7f3a400f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:40.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.363 7f3a45c11700 1 -- 172.21.15.57:0/3965332592 shutdown_connections 2024-04-25T02:06:40.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.363 7f3a45c11700 1 -- 172.21.15.57:0/3965332592 wait complete. 2024-04-25T02:06:40.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a45c11700 1 Processor -- start 2024-04-25T02:06:40.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a45c11700 1 -- start start 2024-04-25T02:06:40.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a45c11700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a400d7350 0x7f3a400ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a45c11700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a400cea20 0x7f3a401afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a45c11700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a400cee70 0x7f3a401b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a45c11700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400d6cf0 con 0x7f3a400cee70 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a45c11700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a401b0950 con 0x7f3a400d7350 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a45c11700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a401b0b80 con 0x7f3a400cea20 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a3f05e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a400cee70 0x7f3a401b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a3e85d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a400d7350 0x7f3a400ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a3e05c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a400cea20 0x7f3a401afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a3f05e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a400cee70 0x7f3a401b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49096/0 (socket says 172.21.15.57:49096) 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a3e05c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a400cea20 0x7f3a401afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48870/0 (socket says 172.21.15.57:48870) 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a3e85d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a400d7350 0x7f3a400ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49970/0 (socket says 172.21.15.57:49970) 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.387 7f3a3f05e700 1 -- 172.21.15.57:0/3717091671 learned_addr learned my addr 172.21.15.57:0/3717091671 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:40.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a3e05c700 1 -- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a400d7350 msgr2=0x7f3a400ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a3e05c700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a400d7350 0x7f3a400ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a3e05c700 1 -- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a400cee70 msgr2=0x7f3a401b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a3e05c700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a400cee70 0x7f3a401b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a3e05c700 1 -- 172.21.15.57:0/3717091671 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a401b7460 con 0x7f3a400cea20 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a3f05e700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a400cee70 0x7f3a401b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a3e85d700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a400d7350 0x7f3a400ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a3e05c700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a400cea20 0x7f3a401afcf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3a3400e000 tx=0x7f3a340091c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a2ffff700 1 -- 172.21.15.57:0/3717091671 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a401b7460 con 0x7f3a400cea20 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a2ffff700 1 -- 172.21.15.57:0/3717091671 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3400cbb0 con 0x7f3a400cea20 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a2ffff700 1 -- 172.21.15.57:0/3717091671 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3a34010440 con 0x7f3a400cea20 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a401b7660 con 0x7f3a400cea20 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a401b7860 con 0x7f3a400cea20 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a2ffff700 1 -- 172.21.15.57:0/3717091671 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3a34010640 con 0x7f3a400cea20 2024-04-25T02:06:40.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.388 7f3a2ffff700 1 -- 172.21.15.57:0/3717091671 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3a3401bd70 con 0x7f3a400cea20 2024-04-25T02:06:40.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.389 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a400dd540 con 0x7f3a400cea20 2024-04-25T02:06:40.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.392 7f3a2ffff700 1 -- 172.21.15.57:0/3717091671 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f3a3400c7b0 con 0x7f3a400cea20 2024-04-25T02:06:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.534 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3a400f08e0 con 0x7f3a400cea20 2024-04-25T02:06:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.534 7f3a2ffff700 1 -- 172.21.15.57:0/3717091671 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3a34000c30 con 0x7f3a400cea20 2024-04-25T02:06:40.542 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:06:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 >> v1:172.21.15.57:6816/43033 conn(0x7f3a1c0145b0 legacy=0x7f3a1c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a400cea20 msgr2=0x7f3a401afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a400cea20 0x7f3a401afcf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f3a3400e000 tx=0x7f3a340091c0).stop 2024-04-25T02:06:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 shutdown_connections 2024-04-25T02:06:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a400cee70 0x7f3a401b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a400d7350 0x7f3a400ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 --2- 172.21.15.57:0/3717091671 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a400cea20 0x7f3a401afcf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 >> 172.21.15.57:0/3717091671 conn(0x7f3a400c4a60 msgr2=0x7f3a400e05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 shutdown_connections 2024-04-25T02:06:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:40.536 7f3a45c11700 1 -- 172.21.15.57:0/3717091671 wait complete. 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:06:40.554 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:06:40.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:40.555 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2024-04-25T02:06:40.604 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:06:40.604 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:40.605 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42545sec preferred_lft 42545sec 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 26:a8:c2:f6:36:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::28e1:77ff:fed1:a187/64 scope link 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 26:a8:c2:f6:36:2d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:06:40.606 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::24a8:c2ff:fef6:362d/64 scope link 2024-04-25T02:06:40.607 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:06:40.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:40.608 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:06:40.675 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-04-25T02:06:40.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:40.678 DEBUG:teuthology.orchestra.run.smithi088:> route 2024-04-25T02:06:40.727 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2024-04-25T02:06:40.727 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:06:40.727 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:06:40.727 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:06:40.727 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:06:40.727 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:06:40.727 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-25T02:06:40.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:06:40.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:06:40.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:06:40.728 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-25T02:06:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:06:40.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:40.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:40.939 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-25T02:06:40.984 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:06:40.984 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:06:40.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:40.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2024-04-25T02:06:41.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:06:41.093 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:41.136 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:06:41.136 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:06:41.137 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:41.220 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T02:06:41.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:41.221 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:41.353 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:41.353 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2024-04-25T02:06:41.353 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "norbytes", passing to kernel. 2024-04-25T02:06:41.353 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "mds_namespace", passing to kernel. 2024-04-25T02:06:41.353 INFO:teuthology.orchestra.run.smithi088.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:06:41.383 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T02:06:41.383 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "norequire_active_mds", passing to kernel. 2024-04-25T02:06:41.383 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "norbytes", passing to kernel. 2024-04-25T02:06:41.383 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: unrecognized mount option "mds_namespace", passing to kernel. 2024-04-25T02:06:41.389 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:06:41.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:41.390 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:41.457 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:06:41.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:06:41.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-25T02:06:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:06:41.614 INFO:teuthology.orchestra.run.smithi088.stdout:client4858 2024-04-25T02:06:41.615 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:06:41.615 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:41.659 INFO:tasks.cephfs.test_newops:Test for new getvxattr op... 2024-04-25T02:06:41.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:41.660 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir newop_getvxattr_dir) 2024-04-25T02:06:41.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:41.753 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.pin.random ./newop_getvxattr_dir) 2024-04-25T02:06:41.797 INFO:teuthology.orchestra.run.smithi088.stderr:./newop_getvxattr_dir: ceph.dir.pin.random: No such attribute 2024-04-25T02:06:41.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:06:41.798 INFO:tasks.cephfs.test_newops:Test for new getvxattr op succeeds 2024-04-25T02:06:41.798 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T02:06:41.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:06:41.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T02:06:41.928 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T02:06:41.929 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T02:06:41.929 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:06:41.929 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:41.972 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:06:41.972 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:42.057 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.195 7fbefecf9700 1 Processor -- start 2024-04-25T02:06:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.195 7fbefecf9700 1 -- start start 2024-04-25T02:06:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbefecf9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef80f5920 0x7fbef810c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbefecf9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbef810cdc0 0x7fbef80f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbefecf9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80f26c0 con 0x7fbef810c970 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbefecf9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80fa290 con 0x7fbef810cdc0 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbefecf9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80f95c0 con 0x7fbef80f5920 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef77fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef80f5920 0x7fbef810c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbef810cdc0 0x7fbef80f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef6ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbef810c970 0x7fbef80f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47706/0 (socket says 172.21.15.57:47706) 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef6ffd700 1 -- 172.21.15.57:0/2318335948 learned_addr learned my addr 172.21.15.57:0/2318335948 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef77fe700 1 -- 172.21.15.57:0/2318335948 >> v2:172.21.15.57:3300/0 conn(0x7fbef810cdc0 msgr2=0x7fbef80f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef77fe700 1 --2- 172.21.15.57:0/2318335948 >> v2:172.21.15.57:3300/0 conn(0x7fbef810cdc0 0x7fbef80f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef77fe700 1 -- 172.21.15.57:0/2318335948 >> v1:172.21.15.57:6789/0 conn(0x7fbef810c970 legacy=0x7fbef80f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef77fe700 1 -- 172.21.15.57:0/2318335948 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef81aa5e0 con 0x7fbef80f5920 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef7fff700 1 --2- 172.21.15.57:0/2318335948 >> v2:172.21.15.57:3300/0 conn(0x7fbef810cdc0 0x7fbef80f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.196 7fbef77fe700 1 --2- 172.21.15.57:0/2318335948 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef80f5920 0x7fbef810c340 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbee8002f70 tx=0x7fbee800b970).ready entity=mon.2 client_cookie=a76d58b05a006bcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:42.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbef67fc700 1 -- 172.21.15.57:0/2318335948 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbef81aa5e0 con 0x7fbef80f5920 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbef67fc700 1 -- 172.21.15.57:0/2318335948 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee800d5c0 con 0x7fbef80f5920 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbef67fc700 1 -- 172.21.15.57:0/2318335948 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbee800d990 con 0x7fbef80f5920 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbefecf9700 1 -- 172.21.15.57:0/2318335948 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef80f5920 msgr2=0x7fbef810c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbefecf9700 1 --2- 172.21.15.57:0/2318335948 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef80f5920 0x7fbef810c340 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fbee8002f70 tx=0x7fbee800b970).stop 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbefecf9700 1 -- 172.21.15.57:0/2318335948 shutdown_connections 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbefecf9700 1 --2- 172.21.15.57:0/2318335948 >> v2:172.21.15.57:3300/0 conn(0x7fbef810cdc0 0x7fbef80f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbefecf9700 1 --2- 172.21.15.57:0/2318335948 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef80f5920 0x7fbef810c340 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbefecf9700 1 -- 172.21.15.57:0/2318335948 >> 172.21.15.57:0/2318335948 conn(0x7fbef8113a70 msgr2=0x7fbef80f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbefecf9700 1 -- 172.21.15.57:0/2318335948 shutdown_connections 2024-04-25T02:06:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.197 7fbefecf9700 1 -- 172.21.15.57:0/2318335948 wait complete. 2024-04-25T02:06:42.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.221 7fbefecf9700 1 Processor -- start 2024-04-25T02:06:42.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.221 7fbefecf9700 1 -- start start 2024-04-25T02:06:42.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbefecf9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef81adc20 0x7fbef81ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbefecf9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbef81ae6a0 0x7fbef80d93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbefecf9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbef80d9a20 0x7fbef81bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbefecf9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80f8010 con 0x7fbef81ae6a0 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbefecf9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80da560 con 0x7fbef80d9a20 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbefecf9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81a6f90 con 0x7fbef81adc20 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef81adc20 0x7fbef81ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbef81ae6a0 0x7fbef80d93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef81adc20 0x7fbef81ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48888/0 (socket says 172.21.15.57:48888) 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 -- 172.21.15.57:0/3983974394 learned_addr learned my addr 172.21.15.57:0/3983974394 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbef81ae6a0 0x7fbef80d93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49122/0 (socket says 172.21.15.57:49122) 2024-04-25T02:06:42.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef7fff700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbef80d9a20 0x7fbef81bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 -- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbef80d9a20 msgr2=0x7fbef81bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbef80d9a20 0x7fbef81bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 -- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbef81ae6a0 msgr2=0x7fbef80d93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbef81ae6a0 0x7fbef80d93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 -- 172.21.15.57:0/3983974394 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef81a6a80 con 0x7fbef81adc20 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef6ffd700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbef81ae6a0 0x7fbef80d93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.222 7fbef77fe700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef81adc20 0x7fbef81ae070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fbef80d7ab0 tx=0x7fbee80068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.223 7fbef4ff9700 1 -- 172.21.15.57:0/3983974394 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbef81a6a80 con 0x7fbef81adc20 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.223 7fbef4ff9700 1 -- 172.21.15.57:0/3983974394 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee8006a90 con 0x7fbef81adc20 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.223 7fbef4ff9700 1 -- 172.21.15.57:0/3983974394 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbee8017040 con 0x7fbef81adc20 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.223 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef80d9e70 con 0x7fbef81adc20 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.223 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef81bc320 con 0x7fbef81adc20 2024-04-25T02:06:42.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.223 7fbef4ff9700 1 -- 172.21.15.57:0/3983974394 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fbee8011c00 con 0x7fbef81adc20 2024-04-25T02:06:42.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.223 7fbef4ff9700 1 -- 172.21.15.57:0/3983974394 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fbee8018070 con 0x7fbef81adc20 2024-04-25T02:06:42.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.224 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef80f08e0 con 0x7fbef81adc20 2024-04-25T02:06:42.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.227 7fbef4ff9700 1 -- 172.21.15.57:0/3983974394 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fbee8011800 con 0x7fbef81adc20 2024-04-25T02:06:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.338 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbef80e2430 con 0x7fbef81adc20 2024-04-25T02:06:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.339 7fbef4ff9700 1 -- 172.21.15.57:0/3983974394 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7fbee800d3b0 con 0x7fbef81adc20 2024-04-25T02:06:42.345 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:42.346 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:32.635396","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:06:29.733676","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25 02:06:30.607285","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 >> v1:172.21.15.57:6816/43033 conn(0x7fbedc0145b0 legacy=0x7fbedc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef81adc20 msgr2=0x7fbef81ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef81adc20 0x7fbef81ae070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fbef80d7ab0 tx=0x7fbee80068c0).stop 2024-04-25T02:06:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 shutdown_connections 2024-04-25T02:06:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbef80d9a20 0x7fbef81bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbef81adc20 0x7fbef81ae070 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 --2- 172.21.15.57:0/3983974394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbef81ae6a0 0x7fbef80d93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 >> 172.21.15.57:0/3983974394 conn(0x7fbef80c6d00 msgr2=0x7fbef80d64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:42.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 shutdown_connections 2024-04-25T02:06:42.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.340 7fbefecf9700 1 -- 172.21.15.57:0/3983974394 wait complete. 2024-04-25T02:06:42.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:06:29.733676', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:06:30.607285', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:42.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf9b0dc700 1 Processor -- start 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf9b0dc700 1 -- start start 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf9b0dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf940f5a10 0x7faf9410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf9b0dc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9410b740 0x7faf9419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf9b0dc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf941a0a70 con 0x7faf9410bb90 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf9b0dc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940fa590 con 0x7faf940f5a10 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf9b0dc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf941a0c90 con 0x7faf9410b740 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf92ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9410b740 0x7faf9419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf92ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9410b740 0x7faf9419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49990/0 (socket says 172.21.15.57:49990) 2024-04-25T02:06:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf92ffd700 1 -- 172.21.15.57:0/957874475 learned_addr learned my addr 172.21.15.57:0/957874475 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf937fe700 1 --2- 172.21.15.57:0/957874475 >> v2:172.21.15.57:3300/0 conn(0x7faf940f5a10 0x7faf9410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.486 7faf93fff700 1 --1- 172.21.15.57:0/957874475 >> v1:172.21.15.57:6789/0 conn(0x7faf9410bb90 0x7faf941a0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47710/0 (socket says 172.21.15.57:47710) 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf937fe700 1 -- 172.21.15.57:0/957874475 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9410b740 msgr2=0x7faf9419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf937fe700 1 --2- 172.21.15.57:0/957874475 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9410b740 0x7faf9419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf937fe700 1 -- 172.21.15.57:0/957874475 >> v1:172.21.15.57:6789/0 conn(0x7faf9410bb90 legacy=0x7faf941a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf937fe700 1 -- 172.21.15.57:0/957874475 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf941a93d0 con 0x7faf940f5a10 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf927fc700 1 -- 172.21.15.57:0/957874475 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920565017 0 0) 0x7faf8c001490 con 0x7faf9410bb90 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf92ffd700 1 --2- 172.21.15.57:0/957874475 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9410b740 0x7faf9419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf937fe700 1 --2- 172.21.15.57:0/957874475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf940f5a10 0x7faf9410b110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7faf9410f920 tx=0x7faf8800ba20).ready entity=mon.0 client_cookie=c8480e95c44e15a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf927fc700 1 -- 172.21.15.57:0/957874475 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf941a93d0 con 0x7faf940f5a10 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf927fc700 1 -- 172.21.15.57:0/957874475 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8800d5c0 con 0x7faf940f5a10 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf927fc700 1 -- 172.21.15.57:0/957874475 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf8800d990 con 0x7faf940f5a10 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf9b0dc700 1 -- 172.21.15.57:0/957874475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf940f5a10 msgr2=0x7faf9410b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.487 7faf9b0dc700 1 --2- 172.21.15.57:0/957874475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf940f5a10 0x7faf9410b110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7faf9410f920 tx=0x7faf8800ba20).stop 2024-04-25T02:06:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.488 7faf9b0dc700 1 -- 172.21.15.57:0/957874475 shutdown_connections 2024-04-25T02:06:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.488 7faf9b0dc700 1 --2- 172.21.15.57:0/957874475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf940f5a10 0x7faf9410b110 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.488 7faf9b0dc700 1 --2- 172.21.15.57:0/957874475 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9410b740 0x7faf9419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.488 7faf9b0dc700 1 -- 172.21.15.57:0/957874475 >> 172.21.15.57:0/957874475 conn(0x7faf94113a70 msgr2=0x7faf940f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.488 7faf9b0dc700 1 -- 172.21.15.57:0/957874475 shutdown_connections 2024-04-25T02:06:42.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.488 7faf9b0dc700 1 -- 172.21.15.57:0/957874475 wait complete. 2024-04-25T02:06:42.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.511 7faf9b0dc700 1 Processor -- start 2024-04-25T02:06:42.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf9b0dc700 1 -- start start 2024-04-25T02:06:42.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf9b0dc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf941addd0 0x7faf941ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf9b0dc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf941ae850 0x7faf941b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf9b0dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf941b4e20 0x7faf941b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf9b0dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf941a5f90 con 0x7faf941b4e20 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf9b0dc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf941a59d0 con 0x7faf941ae850 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf9b0dc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf940ccb50 con 0x7faf941addd0 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf937fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf941addd0 0x7faf941ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf92ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf941ae850 0x7faf941b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf93fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf941b4e20 0x7faf941b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf937fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf941addd0 0x7faf941ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48896/0 (socket says 172.21.15.57:48896) 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf93fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf941b4e20 0x7faf941b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49136/0 (socket says 172.21.15.57:49136) 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf92ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf941ae850 0x7faf941b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:49996/0 (socket says 172.21.15.57:49996) 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf937fe700 1 -- 172.21.15.57:0/33363407 learned_addr learned my addr 172.21.15.57:0/33363407 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf937fe700 1 -- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf941ae850 msgr2=0x7faf941b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf937fe700 1 --2- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf941ae850 0x7faf941b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf937fe700 1 -- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf941b4e20 msgr2=0x7faf941b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf937fe700 1 --2- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf941b4e20 0x7faf941b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf937fe700 1 -- 172.21.15.57:0/33363407 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf941bbee0 con 0x7faf941addd0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.512 7faf93fff700 1 --2- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf941b4e20 0x7faf941b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.513 7faf937fe700 1 --2- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf941addd0 0x7faf941ae220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7faf940f28f0 tx=0x7faf880068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.513 7faf90ff9700 1 -- 172.21.15.57:0/33363407 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf941bbee0 con 0x7faf941addd0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.513 7faf90ff9700 1 -- 172.21.15.57:0/33363407 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf880117e0 con 0x7faf941addd0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.513 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf941bc0e0 con 0x7faf941addd0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.513 7faf90ff9700 1 -- 172.21.15.57:0/33363407 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf88011bb0 con 0x7faf941addd0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.513 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf941bc4c0 con 0x7faf941addd0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.513 7faf90ff9700 1 -- 172.21.15.57:0/33363407 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7faf88027460 con 0x7faf941addd0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.513 7faf90ff9700 1 -- 172.21.15.57:0/33363407 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7faf88020120 con 0x7faf941addd0 2024-04-25T02:06:42.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.514 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf940f08e0 con 0x7faf941addd0 2024-04-25T02:06:42.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.517 7faf90ff9700 1 -- 172.21.15.57:0/33363407 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7faf880115d0 con 0x7faf941addd0 2024-04-25T02:06:42.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.630 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf941aef10 con 0x7faf941addd0 2024-04-25T02:06:42.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.630 7faf90ff9700 1 -- 172.21.15.57:0/33363407 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf8800d3b0 con 0x7faf941addd0 2024-04-25T02:06:42.637 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:42.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.631 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 >> v1:172.21.15.57:6816/43033 conn(0x7faf740145b0 legacy=0x7faf74016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.631 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf941addd0 msgr2=0x7faf941ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.631 7faf9b0dc700 1 --2- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf941addd0 0x7faf941ae220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7faf940f28f0 tx=0x7faf880068c0).stop 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.631 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 shutdown_connections 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.631 7faf9b0dc700 1 --2- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf941b4e20 0x7faf941b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.631 7faf9b0dc700 1 --2- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf941addd0 0x7faf941ae220 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.631 7faf9b0dc700 1 --2- 172.21.15.57:0/33363407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf941ae850 0x7faf941b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.631 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 >> 172.21.15.57:0/33363407 conn(0x7faf940c59a0 msgr2=0x7faf940f1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.632 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 shutdown_connections 2024-04-25T02:06:42.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.632 7faf9b0dc700 1 -- 172.21.15.57:0/33363407 wait complete. 2024-04-25T02:06:42.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.776 7fe42197e700 1 Processor -- start 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.776 7fe42197e700 1 -- start start 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe42197e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe41c106530 0x7fe41c10e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe42197e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c10eee0 0x7fe41c0f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe42197e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0f1e30 con 0x7fe41c10ea90 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe42197e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0fb670 con 0x7fe41c106530 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe42197e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c106980 con 0x7fe41c10eee0 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41adc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c10eee0 0x7fe41c0f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41a5c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe41c106530 0x7fe41c10e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe419dc4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe41c10ea90 0x7fe41c0f1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47712/0 (socket says 172.21.15.57:47712) 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41a5c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe41c106530 0x7fe41c10e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49144/0 (socket says 172.21.15.57:49144) 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41adc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c10eee0 0x7fe41c0f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50002/0 (socket says 172.21.15.57:50002) 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe419dc4700 1 -- 172.21.15.57:0/1828909648 learned_addr learned my addr 172.21.15.57:0/1828909648 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41a5c5700 1 -- 172.21.15.57:0/1828909648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c10eee0 msgr2=0x7fe41c0f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41a5c5700 1 --2- 172.21.15.57:0/1828909648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c10eee0 0x7fe41c0f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41a5c5700 1 -- 172.21.15.57:0/1828909648 >> v1:172.21.15.57:6789/0 conn(0x7fe41c10ea90 legacy=0x7fe41c0f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41a5c5700 1 -- 172.21.15.57:0/1828909648 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c1ac7c0 con 0x7fe41c106530 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe4195c3700 1 -- 172.21.15.57:0/1828909648 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294463803 0 0) 0x7fe410001110 con 0x7fe41c10ea90 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41adc6700 1 --2- 172.21.15.57:0/1828909648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c10eee0 0x7fe41c0f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:42.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe41a5c5700 1 --2- 172.21.15.57:0/1828909648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c106530 0x7fe41c10e460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fe41c0f5750 tx=0x7fe40c00ba20).ready entity=mon.0 client_cookie=a5d3fabfe8993124 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.777 7fe4195c3700 1 -- 172.21.15.57:0/1828909648 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe41c1ac7c0 con 0x7fe41c106530 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe4195c3700 1 -- 172.21.15.57:0/1828909648 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c00d5c0 con 0x7fe41c106530 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe4195c3700 1 -- 172.21.15.57:0/1828909648 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe40c00d990 con 0x7fe41c106530 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe42197e700 1 -- 172.21.15.57:0/1828909648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c106530 msgr2=0x7fe41c10e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe42197e700 1 --2- 172.21.15.57:0/1828909648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c106530 0x7fe41c10e460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fe41c0f5750 tx=0x7fe40c00ba20).stop 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe42197e700 1 -- 172.21.15.57:0/1828909648 shutdown_connections 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe42197e700 1 --2- 172.21.15.57:0/1828909648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c10eee0 0x7fe41c0f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe42197e700 1 --2- 172.21.15.57:0/1828909648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c106530 0x7fe41c10e460 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe42197e700 1 -- 172.21.15.57:0/1828909648 >> 172.21.15.57:0/1828909648 conn(0x7fe41c114940 msgr2=0x7fe41c114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:42.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe42197e700 1 -- 172.21.15.57:0/1828909648 shutdown_connections 2024-04-25T02:06:42.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.778 7fe42197e700 1 -- 172.21.15.57:0/1828909648 wait complete. 2024-04-25T02:06:42.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.802 7fe42197e700 1 Processor -- start 2024-04-25T02:06:42.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.802 7fe42197e700 1 -- start start 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.802 7fe42197e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe41c0deb30 0x7fe41c1adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.802 7fe42197e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c1ae590 0x7fe41c1b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.802 7fe42197e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c1ae9e0 0x7fe41c1b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.802 7fe42197e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0f0250 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe42197e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0d7900 con 0x7fe41c1ae590 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe42197e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0d7220 con 0x7fe41c0deb30 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe419dc4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c1ae590 0x7fe41c1b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41a5c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe41c0deb30 0x7fe41c1adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41adc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c1ae9e0 0x7fe41c1b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe419dc4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c1ae590 0x7fe41c1b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50012/0 (socket says 172.21.15.57:50012) 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41a5c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe41c0deb30 0x7fe41c1adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48908/0 (socket says 172.21.15.57:48908) 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41adc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c1ae9e0 0x7fe41c1b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49152/0 (socket says 172.21.15.57:49152) 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe419dc4700 1 -- 172.21.15.57:0/2859233097 learned_addr learned my addr 172.21.15.57:0/2859233097 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41adc6700 1 -- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe41c0deb30 msgr2=0x7fe41c1adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41adc6700 1 --2- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe41c0deb30 0x7fe41c1adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41adc6700 1 -- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c1ae590 msgr2=0x7fe41c1b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41adc6700 1 --2- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c1ae590 0x7fe41c1b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41adc6700 1 -- 172.21.15.57:0/2859233097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0d74e0 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41a5c5700 1 --2- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe41c0deb30 0x7fe41c1adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe41adc6700 1 --2- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c1ae9e0 0x7fe41c1b4e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fe41c0c51d0 tx=0x7fe41400edd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe40b7fe700 1 -- 172.21.15.57:0/2859233097 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe41c0d74e0 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe40b7fe700 1 -- 172.21.15.57:0/2859233097 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41400c880 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe40b7fe700 1 -- 172.21.15.57:0/2859233097 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe41400f040 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe42197e700 1 -- 172.21.15.57:0/2859233097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c1b5490 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.803 7fe42197e700 1 -- 172.21.15.57:0/2859233097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c1bc030 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.804 7fe40b7fe700 1 -- 172.21.15.57:0/2859233097 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe414011070 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.804 7fe40b7fe700 1 -- 172.21.15.57:0/2859233097 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe414010040 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.804 7fe42197e700 1 -- 172.21.15.57:0/2859233097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c0f08e0 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.808 7fe40b7fe700 1 -- 172.21.15.57:0/2859233097 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe41400c670 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.919 7fe42197e700 1 -- 172.21.15.57:0/2859233097 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe41c0c4960 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.919 7fe40b7fe700 1 -- 172.21.15.57:0/2859233097 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe41c115700 con 0x7fe41c1ae9e0 2024-04-25T02:06:42.926 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 -- 172.21.15.57:0/2859233097 >> v1:172.21.15.57:6816/43033 conn(0x7fe3f80145b0 legacy=0x7fe3f8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 -- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c1ae9e0 msgr2=0x7fe41c1b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 --2- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c1ae9e0 0x7fe41c1b4e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fe41c0c51d0 tx=0x7fe41400edd0).stop 2024-04-25T02:06:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 -- 172.21.15.57:0/2859233097 shutdown_connections 2024-04-25T02:06:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 --2- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe41c1ae9e0 0x7fe41c1b4e60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 --2- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe41c0deb30 0x7fe41c1adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 --2- 172.21.15.57:0/2859233097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe41c1ae590 0x7fe41c1b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:42.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 -- 172.21.15.57:0/2859233097 >> 172.21.15.57:0/2859233097 conn(0x7fe41c0ca320 msgr2=0x7fe41c0c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:42.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 -- 172.21.15.57:0/2859233097 shutdown_connections 2024-04-25T02:06:42.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:42.921 7fe42197e700 1 -- 172.21.15.57:0/2859233097 wait complete. 2024-04-25T02:06:42.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:43.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.065 7fd0280d1700 1 Processor -- start 2024-04-25T02:06:43.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd0280d1700 1 -- start start 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd0280d1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd0200f5920 0x7fd0200f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd0280d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200f1ec0 0x7fd02010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd0280d1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0200f9230 con 0x7fd0200f2310 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd0280d1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02010f0e0 con 0x7fd0200f5920 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd0280d1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0201ac680 con 0x7fd0200f1ec0 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd024ecc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd0200f5920 0x7fd0200f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd0256cd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd0200f2310 0x7fd02010e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47716/0 (socket says 172.21.15.57:47716) 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd0256cd700 1 -- 172.21.15.57:0/1291074543 learned_addr learned my addr 172.21.15.57:0/1291074543 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.066 7fd01ffff700 1 --2- 172.21.15.57:0/1291074543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200f1ec0 0x7fd02010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01f7fe700 1 -- 172.21.15.57:0/1291074543 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974989742 0 0) 0x7fd018001490 con 0x7fd0200f2310 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01f7fe700 1 -- 172.21.15.57:0/1291074543 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd004003270 con 0x7fd0200f2310 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01ffff700 1 -- 172.21.15.57:0/1291074543 >> v2:172.21.15.57:3300/0 conn(0x7fd0200f5920 msgr2=0x7fd0200f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:43.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01ffff700 1 --2- 172.21.15.57:0/1291074543 >> v2:172.21.15.57:3300/0 conn(0x7fd0200f5920 0x7fd0200f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01ffff700 1 -- 172.21.15.57:0/1291074543 >> v1:172.21.15.57:6789/0 conn(0x7fd0200f2310 legacy=0x7fd02010e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01ffff700 1 -- 172.21.15.57:0/1291074543 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0201ac830 con 0x7fd0200f1ec0 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd024ecc700 1 --2- 172.21.15.57:0/1291074543 >> v2:172.21.15.57:3300/0 conn(0x7fd0200f5920 0x7fd0200f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01ffff700 1 --2- 172.21.15.57:0/1291074543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200f1ec0 0x7fd02010e2b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd00c002f70 tx=0x7fd00c00b970).ready entity=mon.1 client_cookie=1e276a54e2ce9c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01f7fe700 1 -- 172.21.15.57:0/1291074543 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0201ac830 con 0x7fd0200f1ec0 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01f7fe700 1 -- 172.21.15.57:0/1291074543 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c00d610 con 0x7fd0200f1ec0 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd01f7fe700 1 -- 172.21.15.57:0/1291074543 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd00c00d9e0 con 0x7fd0200f1ec0 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd0280d1700 1 -- 172.21.15.57:0/1291074543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200f1ec0 msgr2=0x7fd02010e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.067 7fd0280d1700 1 --2- 172.21.15.57:0/1291074543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200f1ec0 0x7fd02010e2b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd00c002f70 tx=0x7fd00c00b970).stop 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.068 7fd0280d1700 1 -- 172.21.15.57:0/1291074543 shutdown_connections 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.068 7fd0280d1700 1 --2- 172.21.15.57:0/1291074543 >> v2:172.21.15.57:3300/0 conn(0x7fd0200f5920 0x7fd0200f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.068 7fd0280d1700 1 --2- 172.21.15.57:0/1291074543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200f1ec0 0x7fd02010e2b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.068 7fd0280d1700 1 -- 172.21.15.57:0/1291074543 >> 172.21.15.57:0/1291074543 conn(0x7fd020113a70 msgr2=0x7fd0200f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:43.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.068 7fd0280d1700 1 -- 172.21.15.57:0/1291074543 shutdown_connections 2024-04-25T02:06:43.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.068 7fd0280d1700 1 -- 172.21.15.57:0/1291074543 wait complete. 2024-04-25T02:06:43.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.091 7fd0280d1700 1 Processor -- start 2024-04-25T02:06:43.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.091 7fd0280d1700 1 -- start start 2024-04-25T02:06:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd0280d1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd0200c3ea0 0x7fd0200c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd0280d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0200c4920 0x7fd0200ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd0280d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200cecb0 0x7fd0201bc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd0280d1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200bcb90 con 0x7fd0200c4920 2024-04-25T02:06:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd0280d1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c5670 con 0x7fd0200cecb0 2024-04-25T02:06:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd0280d1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c4f00 con 0x7fd0200c3ea0 2024-04-25T02:06:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd0256cd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200cecb0 0x7fd0201bc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd01ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0200c4920 0x7fd0200ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd024ecc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd0200c3ea0 0x7fd0200c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd01ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0200c4920 0x7fd0200ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49168/0 (socket says 172.21.15.57:49168) 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd0256cd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200cecb0 0x7fd0201bc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50024/0 (socket says 172.21.15.57:50024) 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd01ffff700 1 -- 172.21.15.57:0/3666270955 learned_addr learned my addr 172.21.15.57:0/3666270955 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd01ffff700 1 -- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd0200c3ea0 msgr2=0x7fd0200c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd01ffff700 1 --2- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd0200c3ea0 0x7fd0200c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.092 7fd01ffff700 1 -- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200cecb0 msgr2=0x7fd0201bc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd01ffff700 1 --2- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200cecb0 0x7fd0201bc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd01ffff700 1 -- 172.21.15.57:0/3666270955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200cf100 con 0x7fd0200c4920 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd0256cd700 1 --2- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200cecb0 0x7fd0201bc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd01ffff700 1 --2- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0200c4920 0x7fd0200ce680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fd0200c3c30 tx=0x7fd00c00a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd01dffb700 1 -- 172.21.15.57:0/3666270955 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0200cf100 con 0x7fd0200c4920 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd01dffb700 1 -- 172.21.15.57:0/3666270955 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c013a90 con 0x7fd0200c4920 2024-04-25T02:06:43.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0200cf3c0 con 0x7fd0200c4920 2024-04-25T02:06:43.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd01dffb700 1 -- 172.21.15.57:0/3666270955 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd00c01f450 con 0x7fd0200c4920 2024-04-25T02:06:43.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0201bc840 con 0x7fd0200c4920 2024-04-25T02:06:43.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd01dffb700 1 -- 172.21.15.57:0/3666270955 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd00c0293f0 con 0x7fd0200c4920 2024-04-25T02:06:43.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.093 7fd01dffb700 1 -- 172.21.15.57:0/3666270955 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd00c0170d0 con 0x7fd0200c4920 2024-04-25T02:06:43.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.094 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0200f08e0 con 0x7fd0200c4920 2024-04-25T02:06:43.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.097 7fd01dffb700 1 -- 172.21.15.57:0/3666270955 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd00c013880 con 0x7fd0200c4920 2024-04-25T02:06:43.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.208 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0200a85b0 con 0x7fd0200c4920 2024-04-25T02:06:43.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.208 7fd01dffb700 1 -- 172.21.15.57:0/3666270955 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd00c00d400 con 0x7fd0200c4920 2024-04-25T02:06:43.215 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:43.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 >> v1:172.21.15.57:6816/43033 conn(0x7fd0080145b0 legacy=0x7fd008016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0200c4920 msgr2=0x7fd0200ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 --2- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0200c4920 0x7fd0200ce680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fd0200c3c30 tx=0x7fd00c00a040).stop 2024-04-25T02:06:43.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 shutdown_connections 2024-04-25T02:06:43.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 --2- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0200cecb0 0x7fd0201bc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 --2- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd0200c3ea0 0x7fd0200c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 --2- 172.21.15.57:0/3666270955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0200c4920 0x7fd0200ce680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 >> 172.21.15.57:0/3666270955 conn(0x7fd0200dcd00 msgr2=0x7fd0200d8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:43.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 shutdown_connections 2024-04-25T02:06:43.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.209 7fd0280d1700 1 -- 172.21.15.57:0/3666270955 wait complete. 2024-04-25T02:06:43.227 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.352 7fafa0aac700 1 Processor -- start 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7fafa0aac700 1 -- start start 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7fafa0aac700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf9c0f5a00 0x7faf9c10b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7fafa0aac700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c10b730 0x7faf9c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7fafa0aac700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c10bb80 0x7faf9c1a0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7fafa0aac700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0fa580 con 0x7faf9c0f5a00 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7fafa0aac700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1a0890 con 0x7faf9c10b730 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7fafa0aac700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1a0ac0 con 0x7faf9c10bb80 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf99850700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf9c0f5a00 0x7faf9c10b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf9904f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c10b730 0x7faf9c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf9a051700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c10bb80 0x7faf9c1a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf99850700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf9c0f5a00 0x7faf9c10b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49178/0 (socket says 172.21.15.57:49178) 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf9904f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c10b730 0x7faf9c19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50034/0 (socket says 172.21.15.57:50034) 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf99850700 1 -- 172.21.15.57:0/2821814247 learned_addr learned my addr 172.21.15.57:0/2821814247 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf9a051700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c10bb80 0x7faf9c1a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48926/0 (socket says 172.21.15.57:48926) 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf99850700 1 -- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c10bb80 msgr2=0x7faf9c1a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.353 7faf99850700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c10bb80 0x7faf9c1a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf99850700 1 -- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c10b730 msgr2=0x7faf9c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf99850700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c10b730 0x7faf9c19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf99850700 1 -- 172.21.15.57:0/2821814247 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c1a73a0 con 0x7faf9c0f5a00 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf9a051700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c10bb80 0x7faf9c1a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf9904f700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c10b730 0x7faf9c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf99850700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0f5a00 0x7faf9c10b100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7faf8c002f70 tx=0x7faf8c009a50).ready entity=mon.0 client_cookie=fb5f3c1fe54f953b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf9884e700 1 -- 172.21.15.57:0/2821814247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf9c1a73a0 con 0x7faf9c0f5a00 2024-04-25T02:06:43.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf9884e700 1 -- 172.21.15.57:0/2821814247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c00f510 con 0x7faf9c0f5a00 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7faf9884e700 1 -- 172.21.15.57:0/2821814247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf8c00f6f0 con 0x7faf9c0f5a00 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7fafa0aac700 1 -- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0f5a00 msgr2=0x7faf9c10b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7fafa0aac700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0f5a00 0x7faf9c10b100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7faf8c002f70 tx=0x7faf8c009a50).stop 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7fafa0aac700 1 -- 172.21.15.57:0/2821814247 shutdown_connections 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7fafa0aac700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c10bb80 0x7faf9c1a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7fafa0aac700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c0f5a00 0x7faf9c10b100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7fafa0aac700 1 --2- 172.21.15.57:0/2821814247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c10b730 0x7faf9c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7fafa0aac700 1 -- 172.21.15.57:0/2821814247 >> 172.21.15.57:0/2821814247 conn(0x7faf9c113a60 msgr2=0x7faf9c0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.354 7fafa0aac700 1 -- 172.21.15.57:0/2821814247 shutdown_connections 2024-04-25T02:06:43.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.355 7fafa0aac700 1 -- 172.21.15.57:0/2821814247 wait complete. 2024-04-25T02:06:43.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.378 7fafa0aac700 1 Processor -- start 2024-04-25T02:06:43.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.378 7fafa0aac700 1 -- start start 2024-04-25T02:06:43.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7fafa0aac700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c1a9510 0x7faf9c1a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7fafa0aac700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c1a9f90 0x7faf9c1affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7fafa0aac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c1b05e0 0x7faf9c1b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7fafa0aac700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0c3800 con 0x7faf9c1b05e0 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7fafa0aac700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0df3a0 con 0x7faf9c1a9510 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7fafa0aac700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1b1060 con 0x7faf9c1a9f90 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9a051700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c1b05e0 0x7faf9c1b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9904f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c1a9f90 0x7faf9c1affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9a051700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c1b05e0 0x7faf9c1b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49182/0 (socket says 172.21.15.57:49182) 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf99850700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c1a9510 0x7faf9c1a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9a051700 1 -- 172.21.15.57:0/3699935771 learned_addr learned my addr 172.21.15.57:0/3699935771 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:43.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9904f700 1 -- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c1a9510 msgr2=0x7faf9c1a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9904f700 1 --2- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c1a9510 0x7faf9c1a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9904f700 1 -- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c1b05e0 msgr2=0x7faf9c1b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9904f700 1 --2- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c1b05e0 0x7faf9c1b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9904f700 1 -- 172.21.15.57:0/3699935771 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0da1d0 con 0x7faf9c1a9f90 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9a051700 1 --2- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c1b05e0 0x7faf9c1b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf9904f700 1 --2- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c1a9f90 0x7faf9c1affb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7faf9c0c3e70 tx=0x7faf9000ec50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf8affd700 1 -- 172.21.15.57:0/3699935771 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf9c0da1d0 con 0x7faf9c1a9f90 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf8affd700 1 -- 172.21.15.57:0/3699935771 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9000c810 con 0x7faf9c1a9f90 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c0daa70 con 0x7faf9c1a9f90 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.379 7faf8affd700 1 -- 172.21.15.57:0/3699935771 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faf9000f040 con 0x7faf9c1a9f90 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.380 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c1b7880 con 0x7faf9c1a9f90 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.380 7faf8affd700 1 -- 172.21.15.57:0/3699935771 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7faf90011070 con 0x7faf9c1a9f90 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.380 7faf8affd700 1 -- 172.21.15.57:0/3699935771 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7faf90010040 con 0x7faf9c1a9f90 2024-04-25T02:06:43.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.381 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c0f08d0 con 0x7faf9c1a9f90 2024-04-25T02:06:43.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.384 7faf8affd700 1 -- 172.21.15.57:0/3699935771 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7faf9000ed90 con 0x7faf9c1a9f90 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.537 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 >> v1:172.21.15.57:6816/43033 conn(0x7faf780145b0 legacy=0x7faf78016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.537 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c1a9f90 msgr2=0x7faf9c1affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.537 7fafa0aac700 1 --2- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c1a9f90 0x7faf9c1affb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7faf9c0c3e70 tx=0x7faf9000ec50).stop 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.537 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 shutdown_connections 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.537 7fafa0aac700 1 --2- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf9c1b05e0 0x7faf9c1b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.537 7fafa0aac700 1 --2- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf9c1a9510 0x7faf9c1a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.537 7fafa0aac700 1 --2- 172.21.15.57:0/3699935771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf9c1a9f90 0x7faf9c1affb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.538 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 >> 172.21.15.57:0/3699935771 conn(0x7faf9c0c4720 msgr2=0x7faf9c0c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.538 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 shutdown_connections 2024-04-25T02:06:43.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.538 7fafa0aac700 1 -- 172.21.15.57:0/3699935771 wait complete. 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:no valid command found; 10 closest matches: 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:osd perf 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:osd df {plain|tree} {class|name} {} 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:osd blocked-by 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool stats {} 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool scrub [...] 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool deep-scrub [...] 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool repair [...] 2024-04-25T02:06:43.546 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool force-recovery [...] 2024-04-25T02:06:43.547 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool force-backfill [...] 2024-04-25T02:06:43.547 INFO:teuthology.orchestra.run.smithi057.stderr:osd pool cancel-force-recovery [...] 2024-04-25T02:06:43.547 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: invalid command 2024-04-25T02:06:43.555 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T02:06:43.556 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f397358d700 1 Processor -- start 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f397358d700 1 -- start start 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f397358d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0f5910 0x7f396c0f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f397358d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f396c0f1eb0 0x7f396c10e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f397358d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0f2300 0x7f396c10e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f397358d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c0f9220 con 0x7f396c0f1eb0 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f397358d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c10ef00 con 0x7f396c0f5910 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f397358d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396c1aa650 con 0x7f396c0f2300 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f396bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0f5910 0x7f396c0f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f396b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f396c0f1eb0 0x7f396c10e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f3970b89700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0f2300 0x7f396c10e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f396bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0f5910 0x7f396c0f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50050/0 (socket says 172.21.15.57:50050) 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.682 7f396bfff700 1 -- 172.21.15.57:0/586231385 learned_addr learned my addr 172.21.15.57:0/586231385 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396b7fe700 1 -- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0f2300 msgr2=0x7f396c10e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396b7fe700 1 --2- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0f2300 0x7f396c10e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396b7fe700 1 -- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0f5910 msgr2=0x7f396c0f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396b7fe700 1 --2- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0f5910 0x7f396c0f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396b7fe700 1 -- 172.21.15.57:0/586231385 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c1aa800 con 0x7f396c0f1eb0 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396bfff700 1 --2- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0f5910 0x7f396c0f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396b7fe700 1 --2- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0f1eb0 0x7f396c10e2a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f396c1037e0 tx=0x7f396000ba20).ready entity=mon.0 client_cookie=1bb68414e8594b26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396affd700 1 -- 172.21.15.57:0/586231385 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f396c1aa800 con 0x7f396c0f1eb0 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396affd700 1 -- 172.21.15.57:0/586231385 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396000d570 con 0x7f396c0f1eb0 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.683 7f396affd700 1 -- 172.21.15.57:0/586231385 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f396000d940 con 0x7f396c0f1eb0 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 -- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0f1eb0 msgr2=0x7f396c10e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 --2- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0f1eb0 0x7f396c10e2a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f396c1037e0 tx=0x7f396000ba20).stop 2024-04-25T02:06:43.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 -- 172.21.15.57:0/586231385 shutdown_connections 2024-04-25T02:06:43.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 --2- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0f2300 0x7f396c10e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 --2- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0f5910 0x7f396c0f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 --2- 172.21.15.57:0/586231385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0f1eb0 0x7f396c10e2a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 -- 172.21.15.57:0/586231385 >> 172.21.15.57:0/586231385 conn(0x7f396c113a60 msgr2=0x7f396c0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:43.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 -- 172.21.15.57:0/586231385 shutdown_connections 2024-04-25T02:06:43.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.684 7f397358d700 1 -- 172.21.15.57:0/586231385 wait complete. 2024-04-25T02:06:43.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.708 7f397358d700 1 Processor -- start 2024-04-25T02:06:43.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.708 7f397358d700 1 -- start start 2024-04-25T02:06:43.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f397358d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0d99a0 0x7f396c0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f397358d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0d3a70 0x7f396c1b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f397358d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0d3ec0 0x7f396c1b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:43.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f397358d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c4860 con 0x7f396c0d3a70 2024-04-25T02:06:43.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f397358d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0d9f30 con 0x7f396c0d99a0 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f397358d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396c1b4da0 con 0x7f396c0d3ec0 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0d99a0 0x7f396c0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0d3a70 0x7f396c1b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0d99a0 0x7f396c0d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50066/0 (socket says 172.21.15.57:50066) 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396bfff700 1 -- 172.21.15.57:0/870214726 learned_addr learned my addr 172.21.15.57:0/870214726 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f3970b89700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0d3ec0 0x7f396c1b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396b7fe700 1 -- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0d3ec0 msgr2=0x7f396c1b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396b7fe700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0d3ec0 0x7f396c1b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396b7fe700 1 -- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0d99a0 msgr2=0x7f396c0d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396b7fe700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0d99a0 0x7f396c0d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396b7fe700 1 -- 172.21.15.57:0/870214726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c1b4f80 con 0x7f396c0d3a70 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396bfff700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0d99a0 0x7f396c0d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:43.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f396b7fe700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0d3a70 0x7f396c1b4140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f396c1037e0 tx=0x7f39600068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:43.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f39697fa700 1 -- 172.21.15.57:0/870214726 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f396c1b4f80 con 0x7f396c0d3a70 2024-04-25T02:06:43.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f39697fa700 1 -- 172.21.15.57:0/870214726 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3960006ab0 con 0x7f396c0d3a70 2024-04-25T02:06:43.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f397358d700 1 -- 172.21.15.57:0/870214726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c1bb940 con 0x7f396c0d3a70 2024-04-25T02:06:43.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.709 7f39697fa700 1 -- 172.21.15.57:0/870214726 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3960011bf0 con 0x7f396c0d3a70 2024-04-25T02:06:43.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.710 7f397358d700 1 -- 172.21.15.57:0/870214726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c1bbd20 con 0x7f396c0d3a70 2024-04-25T02:06:43.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.710 7f39697fa700 1 -- 172.21.15.57:0/870214726 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f3960027460 con 0x7f396c0d3a70 2024-04-25T02:06:43.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.710 7f39697fa700 1 -- 172.21.15.57:0/870214726 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f3960020120 con 0x7f396c0d3a70 2024-04-25T02:06:43.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.711 7f397358d700 1 -- 172.21.15.57:0/870214726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c1b51e0 con 0x7f396c0d3a70 2024-04-25T02:06:43.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.714 7f39697fa700 1 -- 172.21.15.57:0/870214726 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f39600117f0 con 0x7f396c0d3a70 2024-04-25T02:06:43.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.837 7f397358d700 1 -- 172.21.15.57:0/870214726 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blacklist ls"} v 0) v1 -- 0x7f396c0f08d0 con 0x7f396c0d3a70 2024-04-25T02:06:43.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.837 7f39697fa700 1 -- 172.21.15.57:0/870214726 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f396000d360 con 0x7f396c0d3a70 2024-04-25T02:06:43.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 -- 172.21.15.57:0/870214726 >> v1:172.21.15.57:6816/43033 conn(0x7f394c0145b0 legacy=0x7f394c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 -- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0d3a70 msgr2=0x7f396c1b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0d3a70 0x7f396c1b4140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f396c1037e0 tx=0x7f39600068c0).stop 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 -- 172.21.15.57:0/870214726 shutdown_connections 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f396c0d3ec0 0x7f396c1b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f396c0d99a0 0x7f396c0d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 --2- 172.21.15.57:0/870214726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f396c0d3a70 0x7f396c1b4140 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 -- 172.21.15.57:0/870214726 >> 172.21.15.57:0/870214726 conn(0x7f396c0c59b0 msgr2=0x7f396c0bf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 -- 172.21.15.57:0/870214726 shutdown_connections 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:43.838 7f397358d700 1 -- 172.21.15.57:0/870214726 wait complete. 2024-04-25T02:06:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-25T02:06:43.856 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:06:43.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:43.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:06:43.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2024-04-25T02:06:43.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:43.937 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:06:43.983 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.109 7f670a3fc700 1 Processor -- start 2024-04-25T02:06:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.109 7f670a3fc700 1 -- start start 2024-04-25T02:06:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f670a3fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f670410e920 0x7f670410ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f670a3fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67040f10e0 0x7f67040f1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f670a3fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f67040f1b60 0x7f67041aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f670a3fc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040fb660 con 0x7f67040f1b60 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f670a3fc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6704111f20 con 0x7f670410e920 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f670a3fc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f670410f3a0 con 0x7f67040f10e0 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703086700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f670410e920 0x7f670410ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6702885700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67040f10e0 0x7f67040f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703887700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f67040f1b60 0x7f67041aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6702885700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67040f10e0 0x7f67040f1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48944/0 (socket says 172.21.15.57:48944) 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703086700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f670410e920 0x7f670410ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50074/0 (socket says 172.21.15.57:50074) 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6702885700 1 -- 172.21.15.57:0/3969761497 learned_addr learned my addr 172.21.15.57:0/3969761497 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703887700 1 -- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67040f10e0 msgr2=0x7f67040f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703887700 1 --2- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67040f10e0 0x7f67040f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703887700 1 -- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f670410e920 msgr2=0x7f670410ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:44.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703887700 1 --2- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f670410e920 0x7f670410ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703887700 1 -- 172.21.15.57:0/3969761497 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040fb220 con 0x7f67040f1b60 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703086700 1 --2- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f670410e920 0x7f670410ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6703887700 1 --2- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67040f1b60 0x7f67041aa4f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f66fc0032f0 tx=0x7f66fc009d10).ready entity=mon.0 client_cookie=a3415ebca4628ca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6702084700 1 -- 172.21.15.57:0/3969761497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67040fb220 con 0x7f67040f1b60 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6702084700 1 -- 172.21.15.57:0/3969761497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc00b800 con 0x7f67040f1b60 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f6702084700 1 -- 172.21.15.57:0/3969761497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66fc00b9e0 con 0x7f67040f1b60 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.110 7f670a3fc700 1 -- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67040f1b60 msgr2=0x7f67041aa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.111 7f670a3fc700 1 --2- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67040f1b60 0x7f67041aa4f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f66fc0032f0 tx=0x7f66fc009d10).stop 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.111 7f670a3fc700 1 -- 172.21.15.57:0/3969761497 shutdown_connections 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.111 7f670a3fc700 1 --2- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67040f1b60 0x7f67041aa4f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.111 7f670a3fc700 1 --2- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f670410e920 0x7f670410ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.111 7f670a3fc700 1 --2- 172.21.15.57:0/3969761497 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67040f10e0 0x7f67040f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.111 7f670a3fc700 1 -- 172.21.15.57:0/3969761497 >> 172.21.15.57:0/3969761497 conn(0x7f6704114940 msgr2=0x7f6704114dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.111 7f670a3fc700 1 -- 172.21.15.57:0/3969761497 shutdown_connections 2024-04-25T02:06:44.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.111 7f670a3fc700 1 -- 172.21.15.57:0/3969761497 wait complete. 2024-04-25T02:06:44.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.135 7f670a3fc700 1 Processor -- start 2024-04-25T02:06:44.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.135 7f670a3fc700 1 -- start start 2024-04-25T02:06:44.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f670a3fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67041ade80 0x7f67041ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f670a3fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67041b45a0 0x7f67041b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f670a3fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67041b5020 0x7f67041bba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f670a3fc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040d3f60 con 0x7f67041ade80 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f670a3fc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c4c90 con 0x7f67041b5020 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f670a3fc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67040d4500 con 0x7f67041b45a0 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67041ade80 0x7f67041ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67041ade80 0x7f67041ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49212/0 (socket says 172.21.15.57:49212) 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 -- 172.21.15.57:0/1383070956 learned_addr learned my addr 172.21.15.57:0/1383070956 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703887700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67041b5020 0x7f67041bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6702885700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67041b45a0 0x7f67041b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 -- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67041b45a0 msgr2=0x7f67041b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67041b45a0 0x7f67041b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 -- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67041b5020 msgr2=0x7f67041bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67041b5020 0x7f67041bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 -- 172.21.15.57:0/1383070956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67041ae900 con 0x7f67041ade80 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703887700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67041b5020 0x7f67041bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.136 7f6703086700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67041ade80 0x7f67041ae2d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f67041a9500 tx=0x7f66f400ec70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.137 7f6700881700 1 -- 172.21.15.57:0/1383070956 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67041ae900 con 0x7f67041ade80 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.137 7f6700881700 1 -- 172.21.15.57:0/1383070956 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f400c940 con 0x7f67041ade80 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.137 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67041b5470 con 0x7f67041ade80 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.137 7f6700881700 1 -- 172.21.15.57:0/1383070956 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f66f400f040 con 0x7f67041ade80 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.137 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67040d5740 con 0x7f67041ade80 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.137 7f6700881700 1 -- 172.21.15.57:0/1383070956 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f66f4011070 con 0x7f67041ade80 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.137 7f6700881700 1 -- 172.21.15.57:0/1383070956 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f66f4010040 con 0x7f67041ade80 2024-04-25T02:06:44.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.138 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67040f08e0 con 0x7f67041ade80 2024-04-25T02:06:44.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.141 7f6700881700 1 -- 172.21.15.57:0/1383070956 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f66f400c540 con 0x7f67041ade80 2024-04-25T02:06:44.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.283 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67040e2430 con 0x7f67041ade80 2024-04-25T02:06:44.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.283 7f6700881700 1 -- 172.21.15.57:0/1383070956 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1700 (secure 0 0 0) 0x7f66f4000c30 con 0x7f67041ade80 2024-04-25T02:06:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:44.290 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:06:31.632273","modified":"2024-04-25 02:06:33.665250","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4684":{"gid":4684,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6817/32905363","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":32905363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-04-25T02:06:44.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.284 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 >> v1:172.21.15.57:6816/43033 conn(0x7f66e80145b0 legacy=0x7f66e8016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.284 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67041ade80 msgr2=0x7f67041ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.284 7f670a3fc700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67041ade80 0x7f67041ae2d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f67041a9500 tx=0x7f66f400ec70).stop 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.284 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 shutdown_connections 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.284 7f670a3fc700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67041b5020 0x7f67041bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.284 7f670a3fc700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67041ade80 0x7f67041ae2d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.284 7f670a3fc700 1 --2- 172.21.15.57:0/1383070956 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67041b45a0 0x7f67041b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.284 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 >> 172.21.15.57:0/1383070956 conn(0x7f67040cfc30 msgr2=0x7f67041a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.285 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 shutdown_connections 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.285 7f670a3fc700 1 -- 172.21.15.57:0/1383070956 wait complete. 2024-04-25T02:06:44.292 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 11 2024-04-25T02:06:44.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb17d0c700 1 Processor -- start 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb17d0c700 1 -- start start 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb17d0c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb1010ec60 0x7fdb101a8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb17d0c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb101a8dc0 0x7fdb101ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb17d0c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1010f0b0 con 0x7fdb10106530 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb17d0c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb100fb670 con 0x7fdb101a8dc0 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb17d0c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10106980 con 0x7fdb1010ec60 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb07fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb1010ec60 0x7fdb101a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb14b07700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdb10106530 0x7fdb1010e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47728/0 (socket says 172.21.15.57:47728) 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb14b07700 1 -- 172.21.15.57:0/1913254323 learned_addr learned my addr 172.21.15.57:0/1913254323 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.428 7fdb15308700 1 --2- 172.21.15.57:0/1913254323 >> v2:172.21.15.57:3300/0 conn(0x7fdb101a8dc0 0x7fdb101ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb077fe700 1 -- 172.21.15.57:0/1913254323 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107128145 0 0) 0x7fdb0c001110 con 0x7fdb10106530 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb077fe700 1 -- 172.21.15.57:0/1913254323 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdafc003270 con 0x7fdb10106530 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb15308700 1 -- 172.21.15.57:0/1913254323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb1010ec60 msgr2=0x7fdb101a8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb15308700 1 --2- 172.21.15.57:0/1913254323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb1010ec60 0x7fdb101a8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb15308700 1 -- 172.21.15.57:0/1913254323 >> v1:172.21.15.57:6789/0 conn(0x7fdb10106530 legacy=0x7fdb1010e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb15308700 1 -- 172.21.15.57:0/1913254323 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb101ac860 con 0x7fdb101a8dc0 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb07fff700 1 --2- 172.21.15.57:0/1913254323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb1010ec60 0x7fdb101a8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb15308700 1 --2- 172.21.15.57:0/1913254323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb101a8dc0 0x7fdb101ab220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fdb100fb820 tx=0x7fdb08009d40).ready entity=mon.0 client_cookie=916bfb61cadc310a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb077fe700 1 -- 172.21.15.57:0/1913254323 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb101ac860 con 0x7fdb101a8dc0 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb077fe700 1 -- 172.21.15.57:0/1913254323 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0800b7c0 con 0x7fdb101a8dc0 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb077fe700 1 -- 172.21.15.57:0/1913254323 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb0800b9a0 con 0x7fdb101a8dc0 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb17d0c700 1 -- 172.21.15.57:0/1913254323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb101a8dc0 msgr2=0x7fdb101ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.429 7fdb17d0c700 1 --2- 172.21.15.57:0/1913254323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb101a8dc0 0x7fdb101ab220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fdb100fb820 tx=0x7fdb08009d40).stop 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.430 7fdb17d0c700 1 -- 172.21.15.57:0/1913254323 shutdown_connections 2024-04-25T02:06:44.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.430 7fdb17d0c700 1 --2- 172.21.15.57:0/1913254323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb101a8dc0 0x7fdb101ab220 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.430 7fdb17d0c700 1 --2- 172.21.15.57:0/1913254323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb1010ec60 0x7fdb101a8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.430 7fdb17d0c700 1 -- 172.21.15.57:0/1913254323 >> 172.21.15.57:0/1913254323 conn(0x7fdb10114940 msgr2=0x7fdb10114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:44.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.430 7fdb17d0c700 1 -- 172.21.15.57:0/1913254323 shutdown_connections 2024-04-25T02:06:44.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.430 7fdb17d0c700 1 -- 172.21.15.57:0/1913254323 wait complete. 2024-04-25T02:06:44.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb17d0c700 1 Processor -- start 2024-04-25T02:06:44.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb17d0c700 1 -- start start 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb17d0c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb100cbfd0 0x7fdb100d5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb17d0c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb100d5f80 0x7fdb101b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb17d0c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb101b4a40 0x7fdb101b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb17d0c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100dade0 con 0x7fdb100cbfd0 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb17d0c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100db020 con 0x7fdb100d5f80 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb17d0c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb101bb8f0 con 0x7fdb101b4a40 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb14b07700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb100cbfd0 0x7fdb100d5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb07fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb100d5f80 0x7fdb101b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb15308700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb101b4a40 0x7fdb101b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb14b07700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb100cbfd0 0x7fdb100d5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49230/0 (socket says 172.21.15.57:49230) 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb07fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb100d5f80 0x7fdb101b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50092/0 (socket says 172.21.15.57:50092) 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.454 7fdb14b07700 1 -- 172.21.15.57:0/3469049275 learned_addr learned my addr 172.21.15.57:0/3469049275 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb15308700 1 -- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb100d5f80 msgr2=0x7fdb101b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb15308700 1 --2- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb100d5f80 0x7fdb101b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb15308700 1 -- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb100cbfd0 msgr2=0x7fdb100d5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb15308700 1 --2- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb100cbfd0 0x7fdb100d5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb15308700 1 -- 172.21.15.57:0/3469049275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb101bbaa0 con 0x7fdb101b4a40 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb14b07700 1 --2- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb100cbfd0 0x7fdb100d5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb15308700 1 --2- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb101b4a40 0x7fdb101b4e90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdb100cbe10 tx=0x7fdb08006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb05ffb700 1 -- 172.21.15.57:0/3469049275 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb101bbaa0 con 0x7fdb101b4a40 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb05ffb700 1 -- 172.21.15.57:0/3469049275 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb08011a10 con 0x7fdb101b4a40 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb05ffb700 1 -- 172.21.15.57:0/3469049275 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb08017040 con 0x7fdb101b4a40 2024-04-25T02:06:44.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb101bbca0 con 0x7fdb101b4a40 2024-04-25T02:06:44.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb101bc080 con 0x7fdb101b4a40 2024-04-25T02:06:44.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.455 7fdb05ffb700 1 -- 172.21.15.57:0/3469049275 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fdb0801c470 con 0x7fdb101b4a40 2024-04-25T02:06:44.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.456 7fdb05ffb700 1 -- 172.21.15.57:0/3469049275 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fdb08018030 con 0x7fdb101b4a40 2024-04-25T02:06:44.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.456 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb100f08e0 con 0x7fdb101b4a40 2024-04-25T02:06:44.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.459 7fdb05ffb700 1 -- 172.21.15.57:0/3469049275 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fdb08011800 con 0x7fdb101b4a40 2024-04-25T02:06:44.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.570 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb100cb610 con 0x7fdb101b4a40 2024-04-25T02:06:44.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.570 7fdb05ffb700 1 -- 172.21.15.57:0/3469049275 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7fdb0800b5b0 con 0x7fdb101b4a40 2024-04-25T02:06:44.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:44.577 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:32.635396","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:06:29.733676","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25 02:06:30.607285","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 >> v1:172.21.15.57:6816/43033 conn(0x7fdaf00145b0 legacy=0x7fdaf0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb101b4a40 msgr2=0x7fdb101b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 --2- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb101b4a40 0x7fdb101b4e90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fdb100cbe10 tx=0x7fdb08006c40).stop 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 shutdown_connections 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 --2- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb101b4a40 0x7fdb101b4e90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 --2- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb100cbfd0 0x7fdb100d5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 --2- 172.21.15.57:0/3469049275 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb100d5f80 0x7fdb101b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 >> 172.21.15.57:0/3469049275 conn(0x7fdb100c6c70 msgr2=0x7fdb100d64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 shutdown_connections 2024-04-25T02:06:44.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.572 7fdb17d0c700 1 -- 172.21.15.57:0/3469049275 wait complete. 2024-04-25T02:06:44.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25 02:05:37.065200', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25 02:06:29.733676', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25 02:06:30.607285', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:06:44.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:06:44.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.718 7fe62da2f700 1 Processor -- start 2024-04-25T02:06:44.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.718 7fe62da2f700 1 -- start start 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.718 7fe62da2f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280f3660 0x7fe6280fe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.718 7fe62da2f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280fea30 0x7fe6280f9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.718 7fe62da2f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe628110ea0 con 0x7fe6280f9840 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe62da2f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe628105920 con 0x7fe6280fea30 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe62da2f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe628103c00 con 0x7fe6280f3660 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe625fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280fea30 0x7fe6280f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe626800700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280f3660 0x7fe6280fe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe625fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280fea30 0x7fe6280f9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50102/0 (socket says 172.21.15.57:50102) 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe626800700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280f3660 0x7fe6280fe400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48964/0 (socket says 172.21.15.57:48964) 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe625fff700 1 -- 172.21.15.57:0/2906514997 learned_addr learned my addr 172.21.15.57:0/2906514997 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:44.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe625fff700 1 -- 172.21.15.57:0/2906514997 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280f3660 msgr2=0x7fe6280fe400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe625fff700 1 --2- 172.21.15.57:0/2906514997 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280f3660 0x7fe6280fe400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe625fff700 1 -- 172.21.15.57:0/2906514997 >> v1:172.21.15.57:6789/0 conn(0x7fe6280f9840 legacy=0x7fe6281a7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe625fff700 1 -- 172.21.15.57:0/2906514997 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280f9c90 con 0x7fe6280fea30 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe626800700 1 --2- 172.21.15.57:0/2906514997 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280f3660 0x7fe6280fe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe625fff700 1 --2- 172.21.15.57:0/2906514997 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280fea30 0x7fe6280f9210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe61c002f70 tx=0x7fe61c009a80).ready entity=mon.1 client_cookie=dcb90c1d7eb40bec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe6257fe700 1 -- 172.21.15.57:0/2906514997 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6280f9c90 con 0x7fe6280fea30 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe6257fe700 1 -- 172.21.15.57:0/2906514997 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c00f510 con 0x7fe6280fea30 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe6257fe700 1 -- 172.21.15.57:0/2906514997 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe61c00f6f0 con 0x7fe6280fea30 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe62da2f700 1 -- 172.21.15.57:0/2906514997 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280fea30 msgr2=0x7fe6280f9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.719 7fe62da2f700 1 --2- 172.21.15.57:0/2906514997 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280fea30 0x7fe6280f9210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe61c002f70 tx=0x7fe61c009a80).stop 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.720 7fe62da2f700 1 -- 172.21.15.57:0/2906514997 shutdown_connections 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.720 7fe62da2f700 1 --2- 172.21.15.57:0/2906514997 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280f3660 0x7fe6280fe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.720 7fe62da2f700 1 --2- 172.21.15.57:0/2906514997 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280fea30 0x7fe6280f9210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.720 7fe62da2f700 1 -- 172.21.15.57:0/2906514997 >> 172.21.15.57:0/2906514997 conn(0x7fe628113a80 msgr2=0x7fe6280f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:44.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.720 7fe62da2f700 1 -- 172.21.15.57:0/2906514997 shutdown_connections 2024-04-25T02:06:44.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.720 7fe62da2f700 1 -- 172.21.15.57:0/2906514997 wait complete. 2024-04-25T02:06:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.744 7fe62da2f700 1 Processor -- start 2024-04-25T02:06:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.744 7fe62da2f700 1 -- start start 2024-04-25T02:06:44.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.744 7fe62da2f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280d5920 0x7fe6280d5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.744 7fe62da2f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6280d63a0 0x7fe6281b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.744 7fe62da2f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6281b4d80 0x7fe6281b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:44.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe62da2f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe628088f20 con 0x7fe6280d63a0 2024-04-25T02:06:44.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe62da2f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c3e90 con 0x7fe6281b4d80 2024-04-25T02:06:44.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe62da2f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280dcc00 con 0x7fe6280d5920 2024-04-25T02:06:44.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe625fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6280d63a0 0x7fe6281b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe625fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6280d63a0 0x7fe6281b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49246/0 (socket says 172.21.15.57:49246) 2024-04-25T02:06:44.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe627001700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6281b4d80 0x7fe6281b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe626800700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280d5920 0x7fe6280d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:44.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe625fff700 1 -- 172.21.15.57:0/1038617119 learned_addr learned my addr 172.21.15.57:0/1038617119 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:44.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe626800700 1 -- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6281b4d80 msgr2=0x7fe6281b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe626800700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6281b4d80 0x7fe6281b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe626800700 1 -- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6280d63a0 msgr2=0x7fe6281b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe626800700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6280d63a0 0x7fe6281b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe626800700 1 -- 172.21.15.57:0/1038617119 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280dd1c0 con 0x7fe6280d5920 2024-04-25T02:06:44.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe625fff700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6280d63a0 0x7fe6281b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:44.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe627001700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6281b4d80 0x7fe6281b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:44.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe626800700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280d5920 0x7fe6280d5d70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe6280c2400 tx=0x7fe61800ec80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:44.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe6177fe700 1 -- 172.21.15.57:0/1038617119 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6280dd1c0 con 0x7fe6280d5920 2024-04-25T02:06:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe6177fe700 1 -- 172.21.15.57:0/1038617119 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61800c810 con 0x7fe6280d5920 2024-04-25T02:06:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6280dcf00 con 0x7fe6280d5920 2024-04-25T02:06:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe6177fe700 1 -- 172.21.15.57:0/1038617119 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe61800f040 con 0x7fe6280d5920 2024-04-25T02:06:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.745 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6281bbec0 con 0x7fe6280d5920 2024-04-25T02:06:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.746 7fe6177fe700 1 -- 172.21.15.57:0/1038617119 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe618011070 con 0x7fe6280d5920 2024-04-25T02:06:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.746 7fe6177fe700 1 -- 172.21.15.57:0/1038617119 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fe618010040 con 0x7fe6280d5920 2024-04-25T02:06:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.746 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6280f08e0 con 0x7fe6280d5920 2024-04-25T02:06:44.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.750 7fe6177fe700 1 -- 172.21.15.57:0/1038617119 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe61800edc0 con 0x7fe6280d5920 2024-04-25T02:06:44.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.860 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe6281aee70 con 0x7fe6280d5920 2024-04-25T02:06:44.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.861 7fe6177fe700 1 -- 172.21.15.57:0/1038617119 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe618000c30 con 0x7fe6280d5920 2024-04-25T02:06:44.868 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T02:06:44.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 >> v1:172.21.15.57:6816/43033 conn(0x7fe6040145b0 legacy=0x7fe604016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280d5920 msgr2=0x7fe6280d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280d5920 0x7fe6280d5d70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe6280c2400 tx=0x7fe61800ec80).stop 2024-04-25T02:06:44.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 shutdown_connections 2024-04-25T02:06:44.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6281b4d80 0x7fe6281b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6280d5920 0x7fe6280d5d70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 --2- 172.21.15.57:0/1038617119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6280d63a0 0x7fe6281b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:44.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 >> 172.21.15.57:0/1038617119 conn(0x7fe6280c4db0 msgr2=0x7fe6280e0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:44.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 shutdown_connections 2024-04-25T02:06:44.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:44.862 7fe62da2f700 1 -- 172.21.15.57:0/1038617119 wait complete. 2024-04-25T02:06:44.880 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:06:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.007 7f88c85f7700 1 Processor -- start 2024-04-25T02:06:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.007 7f88c85f7700 1 -- start start 2024-04-25T02:06:45.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c85f7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88c00f5a10 0x7f88c010b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c85f7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c010b740 0x7f88c019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c85f7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c010bb90 0x7f88c01a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c85f7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00fa590 con 0x7f88c00f5a10 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c85f7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01a08a0 con 0x7f88c010bb90 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c85f7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01a0ad0 con 0x7f88c010b740 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c4bf1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c010b740 0x7f88c019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c5bf3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c010bb90 0x7f88c01a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c53f2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88c00f5a10 0x7f88c010b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c5bf3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c010bb90 0x7f88c01a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50116/0 (socket says 172.21.15.57:50116) 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c4bf1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c010b740 0x7f88c019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48980/0 (socket says 172.21.15.57:48980) 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c5bf3700 1 -- 172.21.15.57:0/4211076857 learned_addr learned my addr 172.21.15.57:0/4211076857 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c53f2700 1 -- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c010b740 msgr2=0x7f88c019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c53f2700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c010b740 0x7f88c019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c53f2700 1 -- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c010bb90 msgr2=0x7f88c01a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c53f2700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c010bb90 0x7f88c01a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c53f2700 1 -- 172.21.15.57:0/4211076857 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c01a73b0 con 0x7f88c00f5a10 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c4bf1700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c010b740 0x7f88c019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c5bf3700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c010bb90 0x7f88c01a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.008 7f88c53f2700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00f5a10 0x7f88c010b110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f88bc002f70 tx=0x7f88bc00b9f0).ready entity=mon.0 client_cookie=cd4c3732d84a70d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88affff700 1 -- 172.21.15.57:0/4211076857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88c01a73b0 con 0x7f88c00f5a10 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88affff700 1 -- 172.21.15.57:0/4211076857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc00d570 con 0x7f88c00f5a10 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88affff700 1 -- 172.21.15.57:0/4211076857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88bc00d940 con 0x7f88c00f5a10 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 -- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00f5a10 msgr2=0x7f88c010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00f5a10 0x7f88c010b110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f88bc002f70 tx=0x7f88bc00b9f0).stop 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 -- 172.21.15.57:0/4211076857 shutdown_connections 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c010bb90 0x7f88c01a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00f5a10 0x7f88c010b110 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 --2- 172.21.15.57:0/4211076857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c010b740 0x7f88c019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 -- 172.21.15.57:0/4211076857 >> 172.21.15.57:0/4211076857 conn(0x7f88c0113a70 msgr2=0x7f88c00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 -- 172.21.15.57:0/4211076857 shutdown_connections 2024-04-25T02:06:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.009 7f88c85f7700 1 -- 172.21.15.57:0/4211076857 wait complete. 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.033 7f88c85f7700 1 Processor -- start 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.033 7f88c85f7700 1 -- start start 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.033 7f88c85f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00d6fa0 0x7f88c00ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.033 7f88c85f7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c00cea20 0x7f88c01b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c85f7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c00cee70 0x7f88c01b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c85f7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00e29d0 con 0x7f88c00d6fa0 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c85f7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00dcf10 con 0x7f88c00cee70 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c85f7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00c3b20 con 0x7f88c00cea20 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c00cea20 0x7f88c01b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c5bf3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c00cee70 0x7f88c01b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c00cea20 0x7f88c01b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48990/0 (socket says 172.21.15.57:48990) 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 -- 172.21.15.57:0/2264987302 learned_addr learned my addr 172.21.15.57:0/2264987302 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c5bf3700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c00cee70 0x7f88c01b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50118/0 (socket says 172.21.15.57:50118) 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c53f2700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00d6fa0 0x7f88c00ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 -- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c00cee70 msgr2=0x7f88c01b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c00cee70 0x7f88c01b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 -- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00d6fa0 msgr2=0x7f88c00ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00d6fa0 0x7f88c00ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 -- 172.21.15.57:0/2264987302 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c01b0ec0 con 0x7f88c00cea20 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c5bf3700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c00cee70 0x7f88c01b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c4bf1700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c00cea20 0x7f88c01b0260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f88c00c5e20 tx=0x7f88b000ded0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88ae7fc700 1 -- 172.21.15.57:0/2264987302 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88c01b0ec0 con 0x7f88c00cea20 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88ae7fc700 1 -- 172.21.15.57:0/2264987302 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b0014040 con 0x7f88c00cea20 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c01b1180 con 0x7f88c00cea20 2024-04-25T02:06:45.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.034 7f88ae7fc700 1 -- 172.21.15.57:0/2264987302 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88b0010af0 con 0x7f88c00cea20 2024-04-25T02:06:45.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.035 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c01b7c40 con 0x7f88c00cea20 2024-04-25T02:06:45.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.035 7f88ae7fc700 1 -- 172.21.15.57:0/2264987302 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f88b0010cf0 con 0x7f88c00cea20 2024-04-25T02:06:45.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.035 7f88ae7fc700 1 -- 172.21.15.57:0/2264987302 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f88b0019d10 con 0x7f88c00cea20 2024-04-25T02:06:45.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.036 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c00f08e0 con 0x7f88c00cea20 2024-04-25T02:06:45.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.039 7f88ae7fc700 1 -- 172.21.15.57:0/2264987302 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f88b0000c30 con 0x7f88c00cea20 2024-04-25T02:06:45.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.149 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88c01aa960 con 0x7f88c00cea20 2024-04-25T02:06:45.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.149 7f88ae7fc700 1 -- 172.21.15.57:0/2264987302 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88b000d0d0 con 0x7f88c00cea20 2024-04-25T02:06:45.156 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:45.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 >> v1:172.21.15.57:6816/43033 conn(0x7f88a00145b0 legacy=0x7f88a0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c00cea20 msgr2=0x7f88c01b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c00cea20 0x7f88c01b0260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f88c00c5e20 tx=0x7f88b000ded0).stop 2024-04-25T02:06:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 shutdown_connections 2024-04-25T02:06:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88c00cee70 0x7f88c01b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88c00d6fa0 0x7f88c00ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 --2- 172.21.15.57:0/2264987302 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88c00cea20 0x7f88c01b0260 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 >> 172.21.15.57:0/2264987302 conn(0x7f88c00c4aa0 msgr2=0x7f88c00e0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 shutdown_connections 2024-04-25T02:06:45.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.150 7f88c85f7700 1 -- 172.21.15.57:0/2264987302 wait complete. 2024-04-25T02:06:45.168 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:06:45.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.295 7fd298e74700 1 Processor -- start 2024-04-25T02:06:45.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.295 7fd298e74700 1 -- start start 2024-04-25T02:06:45.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd298e74700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940f5a10 0x7fd29410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd298e74700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd29410bb90 0x7fd2941a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd298e74700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2941a0a70 con 0x7fd29410b740 2024-04-25T02:06:45.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd298e74700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940fa590 con 0x7fd2940f5a10 2024-04-25T02:06:45.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd298e74700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2941a0c90 con 0x7fd29410bb90 2024-04-25T02:06:45.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd291b64700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940f5a10 0x7fd29410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd291b64700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940f5a10 0x7fd29410b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50134/0 (socket says 172.21.15.57:50134) 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd292365700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd29410bb90 0x7fd2941a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd291b64700 1 -- 172.21.15.57:0/3212025898 learned_addr learned my addr 172.21.15.57:0/3212025898 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd289363700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd29410b740 0x7fd29419fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47760/0 (socket says 172.21.15.57:47760) 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd292365700 1 -- 172.21.15.57:0/3212025898 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940f5a10 msgr2=0x7fd29410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd292365700 1 --2- 172.21.15.57:0/3212025898 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940f5a10 0x7fd29410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd292365700 1 -- 172.21.15.57:0/3212025898 >> v1:172.21.15.57:6789/0 conn(0x7fd29410b740 legacy=0x7fd29419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd291363700 1 -- 172.21.15.57:0/3212025898 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455041151 0 0) 0x7fd27c001110 con 0x7fd29410b740 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd292365700 1 -- 172.21.15.57:0/3212025898 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2941a93d0 con 0x7fd29410bb90 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.296 7fd291b64700 1 --2- 172.21.15.57:0/3212025898 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940f5a10 0x7fd29410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd292365700 1 --2- 172.21.15.57:0/3212025898 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd29410bb90 0x7fd2941a0440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd2940f47c0 tx=0x7fd28c009cf0).ready entity=mon.2 client_cookie=e82160cfae33eab9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd291363700 1 -- 172.21.15.57:0/3212025898 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2941a93d0 con 0x7fd29410bb90 2024-04-25T02:06:45.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd291363700 1 -- 172.21.15.57:0/3212025898 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c00b840 con 0x7fd29410bb90 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd291363700 1 -- 172.21.15.57:0/3212025898 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd28c00ba20 con 0x7fd29410bb90 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd298e74700 1 -- 172.21.15.57:0/3212025898 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd29410bb90 msgr2=0x7fd2941a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd298e74700 1 --2- 172.21.15.57:0/3212025898 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd29410bb90 0x7fd2941a0440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd2940f47c0 tx=0x7fd28c009cf0).stop 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd298e74700 1 -- 172.21.15.57:0/3212025898 shutdown_connections 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd298e74700 1 --2- 172.21.15.57:0/3212025898 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd29410bb90 0x7fd2941a0440 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd298e74700 1 --2- 172.21.15.57:0/3212025898 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940f5a10 0x7fd29410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd298e74700 1 -- 172.21.15.57:0/3212025898 >> 172.21.15.57:0/3212025898 conn(0x7fd294113a70 msgr2=0x7fd2940f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd298e74700 1 -- 172.21.15.57:0/3212025898 shutdown_connections 2024-04-25T02:06:45.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.297 7fd298e74700 1 -- 172.21.15.57:0/3212025898 wait complete. 2024-04-25T02:06:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.321 7fd298e74700 1 Processor -- start 2024-04-25T02:06:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.321 7fd298e74700 1 -- start start 2024-04-25T02:06:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd298e74700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd2940df7d0 0x7fd2940d5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd298e74700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2940d5f60 0x7fd2941b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd298e74700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940d63b0 0x7fd2941b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd298e74700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940db990 con 0x7fd2940d5f60 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd298e74700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940dbc90 con 0x7fd2940d63b0 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd298e74700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2941b1270 con 0x7fd2940df7d0 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd2940df7d0 0x7fd2940d5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd2940df7d0 0x7fd2940d5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49000/0 (socket says 172.21.15.57:49000) 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 -- 172.21.15.57:0/391472259 learned_addr learned my addr 172.21.15.57:0/391472259 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd289363700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2940d5f60 0x7fd2941b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd292365700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940d63b0 0x7fd2941b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 -- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940d63b0 msgr2=0x7fd2941b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940d63b0 0x7fd2941b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 -- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2940d5f60 msgr2=0x7fd2941b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2940d5f60 0x7fd2941b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 -- 172.21.15.57:0/391472259 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2941b1450 con 0x7fd2940df7d0 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd292365700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940d63b0 0x7fd2941b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd289363700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2940d5f60 0x7fd2941b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd291b64700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd2940df7d0 0x7fd2940d5930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fd2940dbfa0 tx=0x7fd28400ec80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd28b7fe700 1 -- 172.21.15.57:0/391472259 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2941b1450 con 0x7fd2940df7d0 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd28b7fe700 1 -- 172.21.15.57:0/391472259 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28400c620 con 0x7fd2940df7d0 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd298e74700 1 -- 172.21.15.57:0/391472259 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2941b7d00 con 0x7fd2940df7d0 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.322 7fd28b7fe700 1 -- 172.21.15.57:0/391472259 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd28400f040 con 0x7fd2940df7d0 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.323 7fd298e74700 1 -- 172.21.15.57:0/391472259 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2941b80e0 con 0x7fd2940df7d0 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.323 7fd28b7fe700 1 -- 172.21.15.57:0/391472259 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fd284022060 con 0x7fd2940df7d0 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.323 7fd28b7fe700 1 -- 172.21.15.57:0/391472259 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7fd284010040 con 0x7fd2940df7d0 2024-04-25T02:06:45.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.324 7fd298e74700 1 -- 172.21.15.57:0/391472259 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2940f08e0 con 0x7fd2940df7d0 2024-04-25T02:06:45.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.327 7fd28b7fe700 1 -- 172.21.15.57:0/391472259 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fd28400edc0 con 0x7fd2940df7d0 2024-04-25T02:06:45.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.439 7fd298e74700 1 -- 172.21.15.57:0/391472259 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2940e2430 con 0x7fd2940df7d0 2024-04-25T02:06:45.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.439 7fd28b7fe700 1 -- 172.21.15.57:0/391472259 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd284000c30 con 0x7fd2940df7d0 2024-04-25T02:06:45.446 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T02:06:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 -- 172.21.15.57:0/391472259 >> v1:172.21.15.57:6816/43033 conn(0x7fd2780145b0 legacy=0x7fd278016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 -- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd2940df7d0 msgr2=0x7fd2940d5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd2940df7d0 0x7fd2940d5930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fd2940dbfa0 tx=0x7fd28400ec80).stop 2024-04-25T02:06:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 -- 172.21.15.57:0/391472259 shutdown_connections 2024-04-25T02:06:45.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2940d63b0 0x7fd2941b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd2940df7d0 0x7fd2940d5930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 --2- 172.21.15.57:0/391472259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2940d5f60 0x7fd2941b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 -- 172.21.15.57:0/391472259 >> 172.21.15.57:0/391472259 conn(0x7fd2941a3de0 msgr2=0x7fd2941a45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:45.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.440 7fd298e74700 1 -- 172.21.15.57:0/391472259 shutdown_connections 2024-04-25T02:06:45.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.441 7fd298e74700 1 -- 172.21.15.57:0/391472259 wait complete. 2024-04-25T02:06:45.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.582 7faa7e09e700 1 Processor -- start 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa7e09e700 1 -- start start 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa7e09e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa780f5a10 0x7faa7810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa7e09e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa7810bb90 0x7faa781a0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa7e09e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa781a0a70 con 0x7faa7810b740 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa7e09e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780fa590 con 0x7faa780f5a10 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa7e09e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa781a0c90 con 0x7faa7810bb90 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa775c7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa7810bb90 0x7faa781a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa765c5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faa7810b740 0x7faa7819fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47774/0 (socket says 172.21.15.57:47774) 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa765c5700 1 -- 172.21.15.57:0/927068296 learned_addr learned my addr 172.21.15.57:0/927068296 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:45.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.583 7faa76dc6700 1 --2- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa780f5a10 0x7faa7810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa775c7700 1 -- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa780f5a10 msgr2=0x7faa7810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa775c7700 1 --2- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa780f5a10 0x7faa7810b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa75dc4700 1 -- 172.21.15.57:0/927068296 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324336887 0 0) 0x7faa60001110 con 0x7faa7810b740 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa775c7700 1 -- 172.21.15.57:0/927068296 >> v1:172.21.15.57:6789/0 conn(0x7faa7810b740 legacy=0x7faa7819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa775c7700 1 -- 172.21.15.57:0/927068296 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa781a93d0 con 0x7faa7810bb90 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa76dc6700 1 --2- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa780f5a10 0x7faa7810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa775c7700 1 --2- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa7810bb90 0x7faa781a0440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7faa780f47c0 tx=0x7faa70009cf0).ready entity=mon.2 client_cookie=dd45aa051c27698d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa75dc4700 1 -- 172.21.15.57:0/927068296 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faa781a93d0 con 0x7faa7810bb90 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa75dc4700 1 -- 172.21.15.57:0/927068296 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000b840 con 0x7faa7810bb90 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa75dc4700 1 -- 172.21.15.57:0/927068296 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faa7000ba20 con 0x7faa7810bb90 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa7e09e700 1 -- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa7810bb90 msgr2=0x7faa781a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa7e09e700 1 --2- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa7810bb90 0x7faa781a0440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7faa780f47c0 tx=0x7faa70009cf0).stop 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa7e09e700 1 -- 172.21.15.57:0/927068296 shutdown_connections 2024-04-25T02:06:45.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa7e09e700 1 --2- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa7810bb90 0x7faa781a0440 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa7e09e700 1 --2- 172.21.15.57:0/927068296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa780f5a10 0x7faa7810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.584 7faa7e09e700 1 -- 172.21.15.57:0/927068296 >> 172.21.15.57:0/927068296 conn(0x7faa78113a70 msgr2=0x7faa780f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:45.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.585 7faa7e09e700 1 -- 172.21.15.57:0/927068296 shutdown_connections 2024-04-25T02:06:45.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.585 7faa7e09e700 1 -- 172.21.15.57:0/927068296 wait complete. 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.608 7faa7e09e700 1 Processor -- start 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.608 7faa7e09e700 1 -- start start 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa7e09e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa781ad910 0x7faa781add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa7e09e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa781ae390 0x7faa781b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa7e09e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa781b4910 0x7faa781b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa7e09e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780e6530 con 0x7faa781ad910 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa7e09e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780c5990 con 0x7faa781ae390 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa7e09e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa780c3280 con 0x7faa781b4910 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa76dc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa781ad910 0x7faa781add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa765c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa781ae390 0x7faa781b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa775c7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa781b4910 0x7faa781b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa765c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa781ae390 0x7faa781b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50148/0 (socket says 172.21.15.57:50148) 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa76dc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa781ad910 0x7faa781add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49276/0 (socket says 172.21.15.57:49276) 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa775c7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa781b4910 0x7faa781b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49010/0 (socket says 172.21.15.57:49010) 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa765c5700 1 -- 172.21.15.57:0/3592764298 learned_addr learned my addr 172.21.15.57:0/3592764298 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa775c7700 1 -- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa781ae390 msgr2=0x7faa781b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa775c7700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa781ae390 0x7faa781b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa775c7700 1 -- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa781ad910 msgr2=0x7faa781add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa775c7700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa781ad910 0x7faa781add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa775c7700 1 -- 172.21.15.57:0/3592764298 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780c3b20 con 0x7faa781b4910 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa76dc6700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa781ad910 0x7faa781add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa765c5700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa781ae390 0x7faa781b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.609 7faa775c7700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa781b4910 0x7faa781b4d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7faa70006fc0 tx=0x7faa70006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.610 7faa6ffff700 1 -- 172.21.15.57:0/3592764298 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faa780c3b20 con 0x7faa781b4910 2024-04-25T02:06:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.610 7faa6ffff700 1 -- 172.21.15.57:0/3592764298 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa70011b60 con 0x7faa781b4910 2024-04-25T02:06:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.610 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa781bbae0 con 0x7faa781b4910 2024-04-25T02:06:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.610 7faa6ffff700 1 -- 172.21.15.57:0/3592764298 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faa70017040 con 0x7faa781b4910 2024-04-25T02:06:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.610 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa781bbec0 con 0x7faa781b4910 2024-04-25T02:06:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.610 7faa6ffff700 1 -- 172.21.15.57:0/3592764298 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7faa7001c470 con 0x7faa781b4910 2024-04-25T02:06:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.610 7faa6ffff700 1 -- 172.21.15.57:0/3592764298 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7faa70018030 con 0x7faa781b4910 2024-04-25T02:06:45.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.611 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa780f08e0 con 0x7faa781b4910 2024-04-25T02:06:45.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.614 7faa6ffff700 1 -- 172.21.15.57:0/3592764298 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7faa70011950 con 0x7faa781b4910 2024-04-25T02:06:45.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.755 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa780e2430 con 0x7faa781b4910 2024-04-25T02:06:45.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.755 7faa6ffff700 1 -- 172.21.15.57:0/3592764298 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1700 (secure 0 0 0) 0x7faa7000b630 con 0x7faa781b4910 2024-04-25T02:06:45.763 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:45.763 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:06:31.632273","modified":"2024-04-25 02:06:33.665250","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4684":{"gid":4684,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6817/32905363","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":32905363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-04-25T02:06:45.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.756 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 >> v1:172.21.15.57:6816/43033 conn(0x7faa5c0145b0 legacy=0x7faa5c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.756 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa781b4910 msgr2=0x7faa781b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.756 7faa7e09e700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa781b4910 0x7faa781b4d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7faa70006fc0 tx=0x7faa70006c40).stop 2024-04-25T02:06:45.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.757 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 shutdown_connections 2024-04-25T02:06:45.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.757 7faa7e09e700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faa781b4910 0x7faa781b4d60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.757 7faa7e09e700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa781ad910 0x7faa781add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.757 7faa7e09e700 1 --2- 172.21.15.57:0/3592764298 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa781ae390 0x7faa781b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.757 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 >> 172.21.15.57:0/3592764298 conn(0x7faa780e03c0 msgr2=0x7faa780f1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:45.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.757 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 shutdown_connections 2024-04-25T02:06:45.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.757 7faa7e09e700 1 -- 172.21.15.57:0/3592764298 wait complete. 2024-04-25T02:06:45.765 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 11 2024-04-25T02:06:45.774 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:45.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f09535b4700 1 Processor -- start 2024-04-25T02:06:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f09535b4700 1 -- start start 2024-04-25T02:06:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f09535b4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0f2090 0x7f094c1a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f09535b4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c1a8c80 0x7f094c1ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f09535b4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0f9230 con 0x7f094c0f5920 2024-04-25T02:06:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f09535b4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0f24e0 con 0x7f094c1a8c80 2024-04-25T02:06:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f09535b4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1ac720 con 0x7f094c0f2090 2024-04-25T02:06:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f094bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f094c0f5920 0x7f094c0f1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47790/0 (socket says 172.21.15.57:47790) 2024-04-25T02:06:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f094bfff700 1 -- 172.21.15.57:0/480299917 learned_addr learned my addr 172.21.15.57:0/480299917 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f094b7fe700 1 --2- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0f2090 0x7f094c1a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.899 7f0950bb0700 1 --2- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c1a8c80 0x7f094c1ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094b7fe700 1 -- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c1a8c80 msgr2=0x7f094c1ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094affd700 1 -- 172.21.15.57:0/480299917 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782576913 0 0) 0x7f093c001110 con 0x7f094c0f5920 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094b7fe700 1 --2- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c1a8c80 0x7f094c1ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094b7fe700 1 -- 172.21.15.57:0/480299917 >> v1:172.21.15.57:6789/0 conn(0x7f094c0f5920 legacy=0x7f094c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094b7fe700 1 -- 172.21.15.57:0/480299917 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c1ac8d0 con 0x7f094c0f2090 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f0950bb0700 1 --2- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c1a8c80 0x7f094c1ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094b7fe700 1 --2- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0f2090 0x7f094c1a8650 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0940002f70 tx=0x7f094000b9a0).ready entity=mon.2 client_cookie=e7b1cc0974d1970b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094affd700 1 -- 172.21.15.57:0/480299917 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f094c1ac8d0 con 0x7f094c0f2090 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094affd700 1 -- 172.21.15.57:0/480299917 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094000d570 con 0x7f094c0f2090 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f094affd700 1 -- 172.21.15.57:0/480299917 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f094000d940 con 0x7f094c0f2090 2024-04-25T02:06:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f09535b4700 1 -- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0f2090 msgr2=0x7f094c1a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.900 7f09535b4700 1 --2- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0f2090 0x7f094c1a8650 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0940002f70 tx=0x7f094000b9a0).stop 2024-04-25T02:06:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.901 7f09535b4700 1 -- 172.21.15.57:0/480299917 shutdown_connections 2024-04-25T02:06:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.901 7f09535b4700 1 --2- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c1a8c80 0x7f094c1ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.901 7f09535b4700 1 --2- 172.21.15.57:0/480299917 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0f2090 0x7f094c1a8650 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.901 7f09535b4700 1 -- 172.21.15.57:0/480299917 >> 172.21.15.57:0/480299917 conn(0x7f094c113a70 msgr2=0x7f094c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.901 7f09535b4700 1 -- 172.21.15.57:0/480299917 shutdown_connections 2024-04-25T02:06:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.901 7f09535b4700 1 -- 172.21.15.57:0/480299917 wait complete. 2024-04-25T02:06:45.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.924 7f09535b4700 1 Processor -- start 2024-04-25T02:06:45.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f09535b4700 1 -- start start 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f09535b4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0bb5e0 0x7f094c0bba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f09535b4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c0bc060 0x7f094c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f09535b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f094c0cec30 0x7f094c1bc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f09535b4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0db2b0 con 0x7f094c0cec30 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f09535b4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0d6630 con 0x7f094c0bc060 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f09535b4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0da500 con 0x7f094c0bb5e0 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f094bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0bb5e0 0x7f094c0bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f0950bb0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f094c0cec30 0x7f094c1bc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f094bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0bb5e0 0x7f094c0bba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49034/0 (socket says 172.21.15.57:49034) 2024-04-25T02:06:45.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f094bfff700 1 -- 172.21.15.57:0/3008165 learned_addr learned my addr 172.21.15.57:0/3008165 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.925 7f094b7fe700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c0bc060 0x7f094c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f0950bb0700 1 -- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0bb5e0 msgr2=0x7f094c0bba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f0950bb0700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0bb5e0 0x7f094c0bba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f0950bb0700 1 -- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c0bc060 msgr2=0x7f094c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f0950bb0700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c0bc060 0x7f094c0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f0950bb0700 1 -- 172.21.15.57:0/3008165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0f0200 con 0x7f094c0cec30 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f094bfff700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0bb5e0 0x7f094c0bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f094b7fe700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c0bc060 0x7f094c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f0950bb0700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f094c0cec30 0x7f094c1bc280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f094c0d6830 tx=0x7f094400ed70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f09497fa700 1 -- 172.21.15.57:0/3008165 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f094c0f0200 con 0x7f094c0cec30 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f09497fa700 1 -- 172.21.15.57:0/3008165 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094400c880 con 0x7f094c0cec30 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f09535b4700 1 -- 172.21.15.57:0/3008165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c0bc7a0 con 0x7f094c0cec30 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f09497fa700 1 -- 172.21.15.57:0/3008165 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f094400f040 con 0x7f094c0cec30 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f09535b4700 1 -- 172.21.15.57:0/3008165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c0cf080 con 0x7f094c0cec30 2024-04-25T02:06:45.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f09497fa700 1 -- 172.21.15.57:0/3008165 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f0944022060 con 0x7f094c0cec30 2024-04-25T02:06:45.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.926 7f09497fa700 1 -- 172.21.15.57:0/3008165 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f0944010040 con 0x7f094c0cec30 2024-04-25T02:06:45.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.927 7f09535b4700 1 -- 172.21.15.57:0/3008165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c0f08e0 con 0x7f094c0cec30 2024-04-25T02:06:45.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:45.930 7f09497fa700 1 -- 172.21.15.57:0/3008165 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f094400c670 con 0x7f094c0cec30 2024-04-25T02:06:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.040 7f09535b4700 1 -- 172.21.15.57:0/3008165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f094c0f22c0 con 0x7f094c0cec30 2024-04-25T02:06:46.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.040 7f09497fa700 1 -- 172.21.15.57:0/3008165 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f094c1145f0 con 0x7f094c0cec30 2024-04-25T02:06:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:46.048 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:32.635396","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:06:29.733676","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25 02:06:30.607285","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 -- 172.21.15.57:0/3008165 >> v1:172.21.15.57:6816/43033 conn(0x7f092c0145b0 legacy=0x7f092c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 -- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f094c0cec30 msgr2=0x7f094c1bc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f094c0cec30 0x7f094c1bc280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f094c0d6830 tx=0x7f094400ed70).stop 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 -- 172.21.15.57:0/3008165 shutdown_connections 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f094c0cec30 0x7f094c1bc280 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f094c0bb5e0 0x7f094c0bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 --2- 172.21.15.57:0/3008165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f094c0bc060 0x7f094c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 -- 172.21.15.57:0/3008165 >> 172.21.15.57:0/3008165 conn(0x7f094c0dcbf0 msgr2=0x7f094c0c1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 -- 172.21.15.57:0/3008165 shutdown_connections 2024-04-25T02:06:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.042 7f09535b4700 1 -- 172.21.15.57:0/3008165 wait complete. 2024-04-25T02:06:46.062 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:06:46.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:46.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.186 7f250c92e700 1 Processor -- start 2024-04-25T02:06:46.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.186 7f250c92e700 1 -- start start 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f250c92e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25080f5a10 0x7f250810b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f250c92e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f250810b740 0x7f250819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f250c92e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f250810bb90 0x7f25081a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f250c92e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25080fa590 con 0x7f250810bb90 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f250c92e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25081a08a0 con 0x7f25080f5a10 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f250c92e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25081a0ad0 con 0x7f250810b740 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f250810b740 0x7f250819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2505dfc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f250810bb90 0x7f25081a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f25055fb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25080f5a10 0x7f250810b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f250810b740 0x7f250819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44972/0 (socket says 172.21.15.57:44972) 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 -- 172.21.15.57:0/1294712751 learned_addr learned my addr 172.21.15.57:0/1294712751 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 -- 172.21.15.57:0/1294712751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25080f5a10 msgr2=0x7f250810b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 --2- 172.21.15.57:0/1294712751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25080f5a10 0x7f250810b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 -- 172.21.15.57:0/1294712751 >> v2:172.21.15.57:3300/0 conn(0x7f250810bb90 msgr2=0x7f25081a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 --2- 172.21.15.57:0/1294712751 >> v2:172.21.15.57:3300/0 conn(0x7f250810bb90 0x7f25081a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 -- 172.21.15.57:0/1294712751 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080f1890 con 0x7f250810b740 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2505dfc700 1 --2- 172.21.15.57:0/1294712751 >> v2:172.21.15.57:3300/0 conn(0x7f250810bb90 0x7f25081a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f25055fb700 1 --2- 172.21.15.57:0/1294712751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25080f5a10 0x7f250810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f2504dfa700 1 --2- 172.21.15.57:0/1294712751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f250810b740 0x7f250819fc40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f24f0002f70 tx=0x7f24f00099d0).ready entity=mon.2 client_cookie=42d7bddf38874a9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f24fffff700 1 -- 172.21.15.57:0/1294712751 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25080f1890 con 0x7f250810b740 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f24fffff700 1 -- 172.21.15.57:0/1294712751 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f000f510 con 0x7f250810b740 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f24fffff700 1 -- 172.21.15.57:0/1294712751 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24f000f6f0 con 0x7f250810b740 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.187 7f250c92e700 1 -- 172.21.15.57:0/1294712751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f250810b740 msgr2=0x7f250819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.188 7f250c92e700 1 --2- 172.21.15.57:0/1294712751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f250810b740 0x7f250819fc40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f24f0002f70 tx=0x7f24f00099d0).stop 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.188 7f250c92e700 1 -- 172.21.15.57:0/1294712751 shutdown_connections 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.188 7f250c92e700 1 --2- 172.21.15.57:0/1294712751 >> v2:172.21.15.57:3300/0 conn(0x7f250810bb90 0x7f25081a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.188 7f250c92e700 1 --2- 172.21.15.57:0/1294712751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25080f5a10 0x7f250810b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.188 7f250c92e700 1 --2- 172.21.15.57:0/1294712751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f250810b740 0x7f250819fc40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.188 7f250c92e700 1 -- 172.21.15.57:0/1294712751 >> 172.21.15.57:0/1294712751 conn(0x7f2508113a70 msgr2=0x7f25080f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.188 7f250c92e700 1 -- 172.21.15.57:0/1294712751 shutdown_connections 2024-04-25T02:06:46.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.188 7f250c92e700 1 -- 172.21.15.57:0/1294712751 wait complete. 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.212 7f250c92e700 1 Processor -- start 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.212 7f250c92e700 1 -- start start 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.212 7f250c92e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f25080c4040 0x7f25081ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f250c92e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25081adfd0 0x7f25081b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f250c92e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25081ae420 0x7f25081b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f250c92e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080d3c10 con 0x7f25081ae420 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f250c92e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25081b4ea0 con 0x7f25081adfd0 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f250c92e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25081b50d0 con 0x7f25080c4040 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f25055fb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f25080c4040 0x7f25081ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25081ae420 0x7f25081b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2504dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25081adfd0 0x7f25081b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25081ae420 0x7f25081b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47106/0 (socket says 172.21.15.57:47106) 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f25055fb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f25080c4040 0x7f25081ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44976/0 (socket says 172.21.15.57:44976) 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 -- 172.21.15.57:0/3845924854 learned_addr learned my addr 172.21.15.57:0/3845924854 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 -- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f25080c4040 msgr2=0x7f25081ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f25080c4040 0x7f25081ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 -- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25081adfd0 msgr2=0x7f25081b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25081adfd0 0x7f25081b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 -- 172.21.15.57:0/3845924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25081b5300 con 0x7f25081ae420 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f25055fb700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f25080c4040 0x7f25081ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2504dfa700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25081adfd0 0x7f25081b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f2505dfc700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25081ae420 0x7f25081b4870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f2500006cd0 tx=0x7f250000ee20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f24fe7fc700 1 -- 172.21.15.57:0/3845924854 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25081b5300 con 0x7f25081ae420 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f24fe7fc700 1 -- 172.21.15.57:0/3845924854 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250000c880 con 0x7f25081ae420 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f24fe7fc700 1 -- 172.21.15.57:0/3845924854 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f250000f040 con 0x7f25081ae420 2024-04-25T02:06:46.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.213 7f250c92e700 1 -- 172.21.15.57:0/3845924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25081bba60 con 0x7f25081ae420 2024-04-25T02:06:46.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.214 7f250c92e700 1 -- 172.21.15.57:0/3845924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25081bbe40 con 0x7f25081ae420 2024-04-25T02:06:46.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.214 7f24fe7fc700 1 -- 172.21.15.57:0/3845924854 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f2500011070 con 0x7f25081ae420 2024-04-25T02:06:46.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.214 7f24fe7fc700 1 -- 172.21.15.57:0/3845924854 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f2500010040 con 0x7f25081ae420 2024-04-25T02:06:46.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.215 7f250c92e700 1 -- 172.21.15.57:0/3845924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25080f08e0 con 0x7f25081ae420 2024-04-25T02:06:46.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.218 7f24fe7fc700 1 -- 172.21.15.57:0/3845924854 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f250000c670 con 0x7f25081ae420 2024-04-25T02:06:46.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.362 7f250c92e700 1 -- 172.21.15.57:0/3845924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25080e2430 con 0x7f25081ae420 2024-04-25T02:06:46.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.363 7f24fe7fc700 1 -- 172.21.15.57:0/3845924854 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1700 (secure 0 0 0) 0x7f25081145f0 con 0x7f25081ae420 2024-04-25T02:06:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:46.370 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:06:31.632273","modified":"2024-04-25 02:06:33.665250","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4684":{"gid":4684,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6817/32905363","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":32905363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-04-25T02:06:46.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 -- 172.21.15.57:0/3845924854 >> v1:172.21.15.57:6816/43033 conn(0x7f24ec0145b0 legacy=0x7f24ec016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 -- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25081ae420 msgr2=0x7f25081b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25081ae420 0x7f25081b4870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f2500006cd0 tx=0x7f250000ee20).stop 2024-04-25T02:06:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 -- 172.21.15.57:0/3845924854 shutdown_connections 2024-04-25T02:06:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25081ae420 0x7f25081b4870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f25080c4040 0x7f25081ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 --2- 172.21.15.57:0/3845924854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25081adfd0 0x7f25081b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 -- 172.21.15.57:0/3845924854 >> 172.21.15.57:0/3845924854 conn(0x7f25080be6e0 msgr2=0x7f25080c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 -- 172.21.15.57:0/3845924854 shutdown_connections 2024-04-25T02:06:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.364 7f250c92e700 1 -- 172.21.15.57:0/3845924854 wait complete. 2024-04-25T02:06:46.372 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 11 2024-04-25T02:06:46.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5adce10700 1 Processor -- start 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5adce10700 1 -- start start 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5adce10700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad810ebe0 0x7f5ad81a8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5adce10700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ad81a8d40 0x7f5ad81ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5adce10700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad810f030 con 0x7f5ad81064b0 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5adce10700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad80fb5f0 con 0x7f5ad81a8d40 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5adce10700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8106900 con 0x7f5ad810ebe0 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5ad5b64700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5ad81064b0 0x7f5ad810e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37770/0 (socket says 172.21.15.57:37770) 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5ad5b64700 1 -- 172.21.15.57:0/307087239 learned_addr learned my addr 172.21.15.57:0/307087239 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5ad6365700 1 --2- 172.21.15.57:0/307087239 >> v2:172.21.15.57:3300/0 conn(0x7f5ad81a8d40 0x7f5ad81ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.507 7f5ad5363700 1 --2- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad810ebe0 0x7f5ad81a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad4b62700 1 -- 172.21.15.57:0/307087239 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188996149 0 0) 0x7f5ac8001110 con 0x7f5ad81064b0 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad4b62700 1 -- 172.21.15.57:0/307087239 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab8003270 con 0x7f5ad81064b0 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad6365700 1 -- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad810ebe0 msgr2=0x7f5ad81a8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad6365700 1 --2- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad810ebe0 0x7f5ad81a8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad6365700 1 -- 172.21.15.57:0/307087239 >> v1:172.21.15.57:6789/0 conn(0x7f5ad81064b0 legacy=0x7f5ad810e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad6365700 1 -- 172.21.15.57:0/307087239 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad81ac7e0 con 0x7f5ad81a8d40 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad5363700 1 --2- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad810ebe0 0x7f5ad81a8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad6365700 1 --2- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad81a8d40 0x7f5ad81ab1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f5ad80fb7a0 tx=0x7f5ad0009d40).ready entity=mon.0 client_cookie=57f52b8ce2291e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad4b62700 1 -- 172.21.15.57:0/307087239 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ad81ac7e0 con 0x7f5ad81a8d40 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad4b62700 1 -- 172.21.15.57:0/307087239 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000b7c0 con 0x7f5ad81a8d40 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5ad4b62700 1 -- 172.21.15.57:0/307087239 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ad000b9a0 con 0x7f5ad81a8d40 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5adce10700 1 -- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad81a8d40 msgr2=0x7f5ad81ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.508 7f5adce10700 1 --2- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad81a8d40 0x7f5ad81ab1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f5ad80fb7a0 tx=0x7f5ad0009d40).stop 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.509 7f5adce10700 1 -- 172.21.15.57:0/307087239 shutdown_connections 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.509 7f5adce10700 1 --2- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad81a8d40 0x7f5ad81ab1a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.509 7f5adce10700 1 --2- 172.21.15.57:0/307087239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad810ebe0 0x7f5ad81a8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.509 7f5adce10700 1 -- 172.21.15.57:0/307087239 >> 172.21.15.57:0/307087239 conn(0x7f5ad81148c0 msgr2=0x7f5ad8114d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.509 7f5adce10700 1 -- 172.21.15.57:0/307087239 shutdown_connections 2024-04-25T02:06:46.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.509 7f5adce10700 1 -- 172.21.15.57:0/307087239 wait complete. 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5adce10700 1 Processor -- start 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5adce10700 1 -- start start 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5adce10700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80ce1d0 0x7f5ad80d6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5adce10700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ad80d6850 0x7f5ad81b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5adce10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80d6ca0 0x7f5ad81b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5adce10700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80c4700 con 0x7f5ad80d6ca0 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5adce10700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad81b4f00 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5adce10700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad81b5100 con 0x7f5ad80d6850 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5b64700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80ce1d0 0x7f5ad80d6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5363700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ad80d6850 0x7f5ad81b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5b64700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80ce1d0 0x7f5ad80d6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40408/0 (socket says 172.21.15.57:40408) 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad6365700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80d6ca0 0x7f5ad81b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5b64700 1 -- 172.21.15.57:0/3030041139 learned_addr learned my addr 172.21.15.57:0/3030041139 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5363700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ad80d6850 0x7f5ad81b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44980/0 (socket says 172.21.15.57:44980) 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5b64700 1 -- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ad80d6850 msgr2=0x7f5ad81b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5b64700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ad80d6850 0x7f5ad81b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5b64700 1 -- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80d6ca0 msgr2=0x7f5ad81b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5b64700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80d6ca0 0x7f5ad81b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5b64700 1 -- 172.21.15.57:0/3030041139 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad81bbaa0 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad5363700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ad80d6850 0x7f5ad81b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.533 7f5ad6365700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80d6ca0 0x7f5ad81b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.534 7f5ad5b64700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80ce1d0 0x7f5ad80d6220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f5ac8000bc0 tx=0x7f5ac800c7e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.534 7f5aceffd700 1 -- 172.21.15.57:0/3030041139 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ad81bbaa0 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.534 7f5aceffd700 1 -- 172.21.15.57:0/3030041139 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac80072e0 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.534 7f5aceffd700 1 -- 172.21.15.57:0/3030041139 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5ac8005810 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.534 7f5adce10700 1 -- 172.21.15.57:0/3030041139 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad81bbca0 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.534 7f5adce10700 1 -- 172.21.15.57:0/3030041139 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad81bc080 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.534 7f5aceffd700 1 -- 172.21.15.57:0/3030041139 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f5ac8005a10 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.534 7f5aceffd700 1 -- 172.21.15.57:0/3030041139 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f5ac80149e0 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.535 7f5adce10700 1 -- 172.21.15.57:0/3030041139 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad80f0860 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.538 7f5aceffd700 1 -- 172.21.15.57:0/3030041139 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f5ac80070d0 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.681 7f5adce10700 1 -- 172.21.15.57:0/3030041139 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ad81ae9a0 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.681 7f5aceffd700 1 -- 172.21.15.57:0/3030041139 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1700 (secure 0 0 0) 0x7f5ad8100050 con 0x7f5ad80ce1d0 2024-04-25T02:06:46.690 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:46.690 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25 02:06:31.632273","modified":"2024-04-25 02:06:33.665250","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4684},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4684":{"gid":4684,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6817/32905363","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":32905363}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 -- 172.21.15.57:0/3030041139 >> v1:172.21.15.57:6816/43033 conn(0x7f5abc0145b0 legacy=0x7f5abc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 -- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80ce1d0 msgr2=0x7f5ad80d6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80ce1d0 0x7f5ad80d6220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f5ac8000bc0 tx=0x7f5ac800c7e0).stop 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 -- 172.21.15.57:0/3030041139 shutdown_connections 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80d6ca0 0x7f5ad81b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80ce1d0 0x7f5ad80d6220 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 --2- 172.21.15.57:0/3030041139 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ad80d6850 0x7f5ad81b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 -- 172.21.15.57:0/3030041139 >> 172.21.15.57:0/3030041139 conn(0x7f5ad80c3ad0 msgr2=0x7f5ad80db0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 -- 172.21.15.57:0/3030041139 shutdown_connections 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.682 7f5adce10700 1 -- 172.21.15.57:0/3030041139 wait complete. 2024-04-25T02:06:46.691 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 11 2024-04-25T02:06:46.701 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:46.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.825 7f1ee5634700 1 Processor -- start 2024-04-25T02:06:46.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.825 7f1ee5634700 1 -- start start 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ee5634700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ee00f5920 0x7f1ee00f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ee5634700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee00f1ec0 0x7f1ee010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ee5634700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee00f9230 con 0x7f1ee00f2310 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ee5634700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee010f0e0 con 0x7f1ee00f5920 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ee5634700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee01ac680 con 0x7f1ee00f1ec0 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1eddab0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee00f1ec0 0x7f1ee010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ede2b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ee00f5920 0x7f1ee00f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1eddab0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee00f1ec0 0x7f1ee010e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40424/0 (socket says 172.21.15.57:40424) 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1eddab0700 1 -- 172.21.15.57:0/3271425887 learned_addr learned my addr 172.21.15.57:0/3271425887 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1edeab2700 1 --1- 172.21.15.57:0/3271425887 >> v1:172.21.15.57:6789/0 conn(0x7f1ee00f2310 0x7f1ee010e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37782/0 (socket says 172.21.15.57:37782) 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ede2b1700 1 -- 172.21.15.57:0/3271425887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee00f1ec0 msgr2=0x7f1ee010e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ede2b1700 1 --2- 172.21.15.57:0/3271425887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee00f1ec0 0x7f1ee010e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ede2b1700 1 -- 172.21.15.57:0/3271425887 >> v1:172.21.15.57:6789/0 conn(0x7f1ee00f2310 legacy=0x7f1ee010e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ede2b1700 1 -- 172.21.15.57:0/3271425887 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee01ac830 con 0x7f1ee00f5920 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1edd2af700 1 -- 172.21.15.57:0/3271425887 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445849128 0 0) 0x7f1ed8001490 con 0x7f1ee00f2310 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1eddab0700 1 --2- 172.21.15.57:0/3271425887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee00f1ec0 0x7f1ee010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1ede2b1700 1 --2- 172.21.15.57:0/3271425887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee00f5920 0x7f1ee00f1890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f1ed0002f70 tx=0x7f1ed000b9f0).ready entity=mon.0 client_cookie=d5b8e18de2e048c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.826 7f1edd2af700 1 -- 172.21.15.57:0/3271425887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ee01ac830 con 0x7f1ee00f5920 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1edd2af700 1 -- 172.21.15.57:0/3271425887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed000d5c0 con 0x7f1ee00f5920 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1edd2af700 1 -- 172.21.15.57:0/3271425887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ed000d9e0 con 0x7f1ee00f5920 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1ee5634700 1 -- 172.21.15.57:0/3271425887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee00f5920 msgr2=0x7f1ee00f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1ee5634700 1 --2- 172.21.15.57:0/3271425887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee00f5920 0x7f1ee00f1890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f1ed0002f70 tx=0x7f1ed000b9f0).stop 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1ee5634700 1 -- 172.21.15.57:0/3271425887 shutdown_connections 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1ee5634700 1 --2- 172.21.15.57:0/3271425887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee00f5920 0x7f1ee00f1890 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1ee5634700 1 --2- 172.21.15.57:0/3271425887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee00f1ec0 0x7f1ee010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1ee5634700 1 -- 172.21.15.57:0/3271425887 >> 172.21.15.57:0/3271425887 conn(0x7f1ee0113a70 msgr2=0x7f1ee00f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1ee5634700 1 -- 172.21.15.57:0/3271425887 shutdown_connections 2024-04-25T02:06:46.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.827 7f1ee5634700 1 -- 172.21.15.57:0/3271425887 wait complete. 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.851 7f1ee5634700 1 Processor -- start 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.851 7f1ee5634700 1 -- start start 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.851 7f1ee5634700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee01b48b0 0x7f1ee01b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.851 7f1ee5634700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee01b5330 0x7f1ee00c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.851 7f1ee5634700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ee00c2d50 0x7f1ee00c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.851 7f1ee5634700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00d2c20 con 0x7f1ee01b48b0 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ee5634700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee00bde80 con 0x7f1ee01b5330 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ee5634700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee01b5780 con 0x7f1ee00c2d50 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee01b5330 0x7f1ee00c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ede2b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee01b48b0 0x7f1ee01b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee01b5330 0x7f1ee00c2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40438/0 (socket says 172.21.15.57:40438) 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 -- 172.21.15.57:0/251237114 learned_addr learned my addr 172.21.15.57:0/251237114 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1edeab2700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ee00c2d50 0x7f1ee00c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 -- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ee00c2d50 msgr2=0x7f1ee00c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ee00c2d50 0x7f1ee00c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 -- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee01b48b0 msgr2=0x7f1ee01b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee01b48b0 0x7f1ee01b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 -- 172.21.15.57:0/251237114 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee00be1c0 con 0x7f1ee01b5330 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ede2b1700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee01b48b0 0x7f1ee01b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1edeab2700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ee00c2d50 0x7f1ee00c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1eddab0700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee01b5330 0x7f1ee00c2720 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1ee00bf120 tx=0x7f1ec800ec80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ed77fe700 1 -- 172.21.15.57:0/251237114 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ee00be1c0 con 0x7f1ee01b5330 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ed77fe700 1 -- 172.21.15.57:0/251237114 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec800c7b0 con 0x7f1ee01b5330 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ee5634700 1 -- 172.21.15.57:0/251237114 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee00c91f0 con 0x7f1ee01b5330 2024-04-25T02:06:46.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ed77fe700 1 -- 172.21.15.57:0/251237114 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ec800f040 con 0x7f1ee01b5330 2024-04-25T02:06:46.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.852 7f1ee5634700 1 -- 172.21.15.57:0/251237114 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee01bc000 con 0x7f1ee01b5330 2024-04-25T02:06:46.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.853 7f1ed77fe700 1 -- 172.21.15.57:0/251237114 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1ec8022060 con 0x7f1ee01b5330 2024-04-25T02:06:46.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.853 7f1ed77fe700 1 -- 172.21.15.57:0/251237114 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f1ec8010040 con 0x7f1ee01b5330 2024-04-25T02:06:46.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.853 7f1ee5634700 1 -- 172.21.15.57:0/251237114 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee00f08e0 con 0x7f1ee01b5330 2024-04-25T02:06:46.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.857 7f1ed77fe700 1 -- 172.21.15.57:0/251237114 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1ec800c5a0 con 0x7f1ee01b5330 2024-04-25T02:06:46.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.967 7f1ee5634700 1 -- 172.21.15.57:0/251237114 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ee00cf020 con 0x7f1ee01b5330 2024-04-25T02:06:46.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.967 7f1ed77fe700 1 -- 172.21.15.57:0/251237114 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+8732 (secure 0 0 0) 0x7f1ec8000c30 con 0x7f1ee01b5330 2024-04-25T02:06:46.974 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:46.975 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:32.635396","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25 02:06:29.733676","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25 02:06:30.607285","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 -- 172.21.15.57:0/251237114 >> v1:172.21.15.57:6816/43033 conn(0x7f1ec40145b0 legacy=0x7f1ec4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 -- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee01b5330 msgr2=0x7f1ee00c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee01b5330 0x7f1ee00c2720 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1ee00bf120 tx=0x7f1ec800ec80).stop 2024-04-25T02:06:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 -- 172.21.15.57:0/251237114 shutdown_connections 2024-04-25T02:06:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ee00c2d50 0x7f1ee00c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ee01b48b0 0x7f1ee01b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 --2- 172.21.15.57:0/251237114 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ee01b5330 0x7f1ee00c2720 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 -- 172.21.15.57:0/251237114 >> 172.21.15.57:0/251237114 conn(0x7f1ee00dc930 msgr2=0x7f1ee00c15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 -- 172.21.15.57:0/251237114 shutdown_connections 2024-04-25T02:06:46.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:46.969 7f1ee5634700 1 -- 172.21.15.57:0/251237114 wait complete. 2024-04-25T02:06:46.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:06:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.112 7f6c760e7700 1 Processor -- start 2024-04-25T02:06:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.112 7f6c760e7700 1 -- start start 2024-04-25T02:06:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.112 7f6c760e7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c7010cab0 0x7f6c701a6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.112 7f6c760e7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6c701a6b50 0x7f6c701a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.112 7f6c760e7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7010cf00 con 0x7f6c700f5890 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.112 7f6c760e7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700fa200 con 0x7f6c701a6b50 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.112 7f6c760e7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700f9530 con 0x7f6c7010cab0 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6edc6700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6c700f5890 0x7f6c7010c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37788/0 (socket says 172.21.15.57:37788) 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6edc6700 1 -- 172.21.15.57:0/877877951 learned_addr learned my addr 172.21.15.57:0/877877951 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6e5c5700 1 --2- 172.21.15.57:0/877877951 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c7010cab0 0x7f6c701a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6f5c7700 1 --2- 172.21.15.57:0/877877951 >> v2:172.21.15.57:3300/0 conn(0x7f6c701a6b50 0x7f6c701a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6ddc4700 1 -- 172.21.15.57:0/877877951 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120466746 0 0) 0x7f6c60001110 con 0x7f6c700f5890 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6ddc4700 1 -- 172.21.15.57:0/877877951 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c50003270 con 0x7f6c700f5890 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6e5c5700 1 -- 172.21.15.57:0/877877951 >> v2:172.21.15.57:3300/0 conn(0x7f6c701a6b50 msgr2=0x7f6c701a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6e5c5700 1 --2- 172.21.15.57:0/877877951 >> v2:172.21.15.57:3300/0 conn(0x7f6c701a6b50 0x7f6c701a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6e5c5700 1 -- 172.21.15.57:0/877877951 >> v1:172.21.15.57:6789/0 conn(0x7f6c700f5890 legacy=0x7f6c7010c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6e5c5700 1 -- 172.21.15.57:0/877877951 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c701aa5f0 con 0x7f6c7010cab0 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6f5c7700 1 --2- 172.21.15.57:0/877877951 >> v2:172.21.15.57:3300/0 conn(0x7f6c701a6b50 0x7f6c701a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6e5c5700 1 --2- 172.21.15.57:0/877877951 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c7010cab0 0x7f6c701a6520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f6c58002f70 tx=0x7f6c5800b970).ready entity=mon.2 client_cookie=71bf34e2b9572f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6ddc4700 1 -- 172.21.15.57:0/877877951 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c701aa5f0 con 0x7f6c7010cab0 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6ddc4700 1 -- 172.21.15.57:0/877877951 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5800d610 con 0x7f6c7010cab0 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c6ddc4700 1 -- 172.21.15.57:0/877877951 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c5800d9e0 con 0x7f6c7010cab0 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c760e7700 1 -- 172.21.15.57:0/877877951 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c7010cab0 msgr2=0x7f6c701a6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.113 7f6c760e7700 1 --2- 172.21.15.57:0/877877951 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c7010cab0 0x7f6c701a6520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f6c58002f70 tx=0x7f6c5800b970).stop 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.114 7f6c760e7700 1 -- 172.21.15.57:0/877877951 shutdown_connections 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.114 7f6c760e7700 1 --2- 172.21.15.57:0/877877951 >> v2:172.21.15.57:3300/0 conn(0x7f6c701a6b50 0x7f6c701a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.114 7f6c760e7700 1 --2- 172.21.15.57:0/877877951 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c7010cab0 0x7f6c701a6520 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.114 7f6c760e7700 1 -- 172.21.15.57:0/877877951 >> 172.21.15.57:0/877877951 conn(0x7f6c701139e0 msgr2=0x7f6c700f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.114 7f6c760e7700 1 -- 172.21.15.57:0/877877951 shutdown_connections 2024-04-25T02:06:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.114 7f6c760e7700 1 -- 172.21.15.57:0/877877951 wait complete. 2024-04-25T02:06:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c760e7700 1 Processor -- start 2024-04-25T02:06:47.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c760e7700 1 -- start start 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c760e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c700ce580 0x7f6c700d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c760e7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c700d5a10 0x7f6c701b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c760e7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c700d5e60 0x7f6c701b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c760e7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700e42d0 con 0x7f6c700ce580 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c760e7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700de0e0 con 0x7f6c700d5a10 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c760e7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c700ceb10 con 0x7f6c700d5e60 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c6edc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c700ce580 0x7f6c700d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c6f5c7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c700d5e60 0x7f6c701b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c6edc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c700ce580 0x7f6c700d53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47170/0 (socket says 172.21.15.57:47170) 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c6e5c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c700d5a10 0x7f6c701b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.138 7f6c6edc6700 1 -- 172.21.15.57:0/505182616 learned_addr learned my addr 172.21.15.57:0/505182616 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c6f5c7700 1 -- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c700d5a10 msgr2=0x7f6c701b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c6f5c7700 1 --2- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c700d5a10 0x7f6c701b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c6f5c7700 1 -- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c700ce580 msgr2=0x7f6c700d53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c6f5c7700 1 --2- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c700ce580 0x7f6c700d53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c6f5c7700 1 -- 172.21.15.57:0/505182616 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c701b2e60 con 0x7f6c700d5e60 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c6f5c7700 1 --2- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c700d5e60 0x7f6c701b2830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6c700d7ad0 tx=0x7f6c6800ecf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c67fff700 1 -- 172.21.15.57:0/505182616 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c701b2e60 con 0x7f6c700d5e60 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c67fff700 1 -- 172.21.15.57:0/505182616 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6800c830 con 0x7f6c700d5e60 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c760e7700 1 -- 172.21.15.57:0/505182616 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c701b3120 con 0x7f6c700d5e60 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c67fff700 1 -- 172.21.15.57:0/505182616 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c6800f040 con 0x7f6c700d5e60 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c760e7700 1 -- 172.21.15.57:0/505182616 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c700f64e0 con 0x7f6c700d5e60 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c67fff700 1 -- 172.21.15.57:0/505182616 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6c68022060 con 0x7f6c700d5e60 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.139 7f6c67fff700 1 -- 172.21.15.57:0/505182616 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3194+0+0 (secure 0 0 0) 0x7f6c68010040 con 0x7f6c700d5e60 2024-04-25T02:06:47.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.140 7f6c760e7700 1 -- 172.21.15.57:0/505182616 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c700f0850 con 0x7f6c700d5e60 2024-04-25T02:06:47.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.143 7f6c67fff700 1 -- 172.21.15.57:0/505182616 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f6c6800c620 con 0x7f6c700d5e60 2024-04-25T02:06:47.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.287 7f6c760e7700 1 -- 172.21.15.57:0/505182616 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6c701ac920 con 0x7f6c700d5e60 2024-04-25T02:06:47.427 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-04-25 02:06:47.420 7f21646cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:06:47.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.441 7f6c67fff700 1 -- 172.21.15.57:0/505182616 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v12) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6c70114560 con 0x7f6c700d5e60 2024-04-25T02:06:47.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.442 7f6c760e7700 1 -- 172.21.15.57:0/505182616 >> v1:172.21.15.57:6816/43033 conn(0x7f6c540145b0 legacy=0x7f6c54016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.442 7f6c760e7700 1 -- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c700d5e60 msgr2=0x7f6c701b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.442 7f6c760e7700 1 --2- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c700d5e60 0x7f6c701b2830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6c700d7ad0 tx=0x7f6c6800ecf0).stop 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.442 7f6c760e7700 1 -- 172.21.15.57:0/505182616 shutdown_connections 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.442 7f6c760e7700 1 --2- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6c700d5e60 0x7f6c701b2830 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.443 7f6c760e7700 1 --2- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c700ce580 0x7f6c700d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.443 7f6c760e7700 1 --2- 172.21.15.57:0/505182616 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c700d5a10 0x7f6c701b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.443 7f6c760e7700 1 -- 172.21.15.57:0/505182616 >> 172.21.15.57:0/505182616 conn(0x7f6c700c6d00 msgr2=0x7f6c700cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.443 7f6c760e7700 1 -- 172.21.15.57:0/505182616 shutdown_connections 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.443 7f6c760e7700 1 -- 172.21.15.57:0/505182616 wait complete. 2024-04-25T02:06:47.450 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:06:47.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:06:47.467 INFO:tasks.ceph.mds.a.smithi057.stderr:warning: line 131: 'mon_down_mkfs_grace' in section 'mon' redefined 2024-04-25T02:06:47.532 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-04-25T02:06:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.599 7f89a1605700 1 Processor -- start 2024-04-25T02:06:47.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.599 7f89a1605700 1 -- start start 2024-04-25T02:06:47.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f89a1605700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0f5900 0x7f899c0f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f89a1605700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f899c0f22f0 0x7f899c10ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f89a1605700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0f9210 con 0x7f899c0f1ea0 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f89a1605700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c10f0c0 con 0x7f899c0f22f0 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f89a1605700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c1ac660 con 0x7f899c0f5900 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899a2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0f5900 0x7f899c0f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899aab2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f899c0f22f0 0x7f899c10ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899a2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0f5900 0x7f899c0f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40450/0 (socket says 172.21.15.57:40450) 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f8999ab0700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f899c0f1ea0 0x7f899c10e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37804/0 (socket says 172.21.15.57:37804) 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899aab2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f899c0f22f0 0x7f899c10ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47182/0 (socket says 172.21.15.57:47182) 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899a2b1700 1 -- 172.21.15.57:0/1022546002 learned_addr learned my addr 172.21.15.57:0/1022546002 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899a2b1700 1 -- 172.21.15.57:0/1022546002 >> v2:172.21.15.57:3300/0 conn(0x7f899c0f22f0 msgr2=0x7f899c10ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:47.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899a2b1700 1 --2- 172.21.15.57:0/1022546002 >> v2:172.21.15.57:3300/0 conn(0x7f899c0f22f0 0x7f899c10ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899a2b1700 1 -- 172.21.15.57:0/1022546002 >> v1:172.21.15.57:6789/0 conn(0x7f899c0f1ea0 legacy=0x7f899c10e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899a2b1700 1 -- 172.21.15.57:0/1022546002 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c1ac810 con 0x7f899c0f5900 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.600 7f899aab2700 1 --2- 172.21.15.57:0/1022546002 >> v2:172.21.15.57:3300/0 conn(0x7f899c0f22f0 0x7f899c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f899a2b1700 1 --2- 172.21.15.57:0/1022546002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0f5900 0x7f899c0f1870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f898c002f70 tx=0x7f898c0099d0).ready entity=mon.1 client_cookie=3a970c883b14385b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89992af700 1 -- 172.21.15.57:0/1022546002 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f899c1ac810 con 0x7f899c0f5900 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89992af700 1 -- 172.21.15.57:0/1022546002 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00f510 con 0x7f899c0f5900 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89992af700 1 -- 172.21.15.57:0/1022546002 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f898c00f6f0 con 0x7f899c0f5900 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89a1605700 1 -- 172.21.15.57:0/1022546002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0f5900 msgr2=0x7f899c0f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89a1605700 1 --2- 172.21.15.57:0/1022546002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0f5900 0x7f899c0f1870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f898c002f70 tx=0x7f898c0099d0).stop 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89a1605700 1 -- 172.21.15.57:0/1022546002 shutdown_connections 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89a1605700 1 --2- 172.21.15.57:0/1022546002 >> v2:172.21.15.57:3300/0 conn(0x7f899c0f22f0 0x7f899c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89a1605700 1 --2- 172.21.15.57:0/1022546002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0f5900 0x7f899c0f1870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89a1605700 1 -- 172.21.15.57:0/1022546002 >> 172.21.15.57:0/1022546002 conn(0x7f899c113a50 msgr2=0x7f899c0f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:47.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.601 7f89a1605700 1 -- 172.21.15.57:0/1022546002 shutdown_connections 2024-04-25T02:06:47.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.602 7f89a1605700 1 -- 172.21.15.57:0/1022546002 wait complete. 2024-04-25T02:06:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.625 7f89a1605700 1 Processor -- start 2024-04-25T02:06:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.625 7f89a1605700 1 -- start start 2024-04-25T02:06:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f89a1605700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0c5340 0x7f899c0d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f89a1605700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f899c0d31d0 0x7f899c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f89a1605700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f899c0d3620 0x7f899c0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f89a1605700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0d5070 con 0x7f899c0d31d0 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f89a1605700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0cf050 con 0x7f899c0c5340 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f89a1605700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f899c1bb890 con 0x7f899c0d3620 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0c5340 0x7f899c0d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0c5340 0x7f899c0d2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40458/0 (socket says 172.21.15.57:40458) 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f8999ab0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f899c0d31d0 0x7f899c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 -- 172.21.15.57:0/1073752981 learned_addr learned my addr 172.21.15.57:0/1073752981 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899aab2700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f899c0d3620 0x7f899c0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 -- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f899c0d3620 msgr2=0x7f899c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f899c0d3620 0x7f899c0cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 -- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f899c0d31d0 msgr2=0x7f899c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f899c0d31d0 0x7f899c0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 -- 172.21.15.57:0/1073752981 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c1bba40 con 0x7f899c0c5340 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f8999ab0700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f899c0d31d0 0x7f899c0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f899a2b1700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0c5340 0x7f899c0d2ba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f899c0bea30 tx=0x7f898c0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.626 7f89937fe700 1 -- 172.21.15.57:0/1073752981 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f899c1bba40 con 0x7f899c0c5340 2024-04-25T02:06:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.627 7f89937fe700 1 -- 172.21.15.57:0/1073752981 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c011a20 con 0x7f899c0c5340 2024-04-25T02:06:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.627 7f89a1605700 1 -- 172.21.15.57:0/1073752981 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c1bbc40 con 0x7f899c0c5340 2024-04-25T02:06:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.627 7f89937fe700 1 -- 172.21.15.57:0/1073752981 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f898c011df0 con 0x7f899c0c5340 2024-04-25T02:06:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.627 7f89a1605700 1 -- 172.21.15.57:0/1073752981 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c1bc020 con 0x7f899c0c5340 2024-04-25T02:06:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.627 7f89937fe700 1 -- 172.21.15.57:0/1073752981 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f898c019030 con 0x7f899c0c5340 2024-04-25T02:06:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.627 7f89937fe700 1 -- 172.21.15.57:0/1073752981 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f898c018040 con 0x7f899c0c5340 2024-04-25T02:06:47.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.628 7f89a1605700 1 -- 172.21.15.57:0/1073752981 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c0f08c0 con 0x7f899c0c5340 2024-04-25T02:06:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.631 7f89937fe700 1 -- 172.21.15.57:0/1073752981 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f898c011810 con 0x7f899c0c5340 2024-04-25T02:06:47.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:47.775 7f89a1605700 1 -- 172.21.15.57:0/1073752981 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f899c1ae8c0 con 0x7f899c0c5340 2024-04-25T02:06:48.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.438 7f89937fe700 1 -- 172.21.15.57:0/1073752981 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f898c00f300 con 0x7f899c0c5340 2024-04-25T02:06:48.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 -- 172.21.15.57:0/1073752981 >> v1:172.21.15.57:6816/43033 conn(0x7f89800145b0 legacy=0x7f8980016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:48.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 -- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0c5340 msgr2=0x7f899c0d2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:48.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0c5340 0x7f899c0d2ba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f899c0bea30 tx=0x7f898c0068c0).stop 2024-04-25T02:06:48.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 -- 172.21.15.57:0/1073752981 shutdown_connections 2024-04-25T02:06:48.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f899c0d3620 0x7f899c0cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:48.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f899c0c5340 0x7f899c0d2ba0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:48.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 --2- 172.21.15.57:0/1073752981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f899c0d31d0 0x7f899c0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:48.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 -- 172.21.15.57:0/1073752981 >> 172.21.15.57:0/1073752981 conn(0x7f899c0c5aa0 msgr2=0x7f899c0bd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:48.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 -- 172.21.15.57:0/1073752981 shutdown_connections 2024-04-25T02:06:48.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.440 7f89a1605700 1 -- 172.21.15.57:0/1073752981 wait complete. 2024-04-25T02:06:48.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:06:48.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.641 7fc18c09a700 1 Processor -- start 2024-04-25T02:06:48.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.641 7fc18c09a700 1 -- start start 2024-04-25T02:06:48.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.641 7fc18c09a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1840f5a00 0x7fc18410b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:48.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc18c09a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc18410bb80 0x7fc1841a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:48.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc18c09a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1841a0a60 con 0x7fc18410b730 2024-04-25T02:06:48.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc18c09a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840fa580 con 0x7fc18410bb80 2024-04-25T02:06:48.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc18c09a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1841a0c80 con 0x7fc1840f5a00 2024-04-25T02:06:48.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc188e95700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1840f5a00 0x7fc18410b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:48.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc183fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc18410b730 0x7fc18419fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37818/0 (socket says 172.21.15.57:37818) 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc189696700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc18410bb80 0x7fc1841a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc183fff700 1 -- 172.21.15.57:0/2629824422 learned_addr learned my addr 172.21.15.57:0/2629824422 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc188e95700 1 -- 172.21.15.57:0/2629824422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc18410bb80 msgr2=0x7fc1841a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc188e95700 1 --2- 172.21.15.57:0/2629824422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc18410bb80 0x7fc1841a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc1837fe700 1 -- 172.21.15.57:0/2629824422 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223968644 0 0) 0x7fc16c001110 con 0x7fc18410b730 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc188e95700 1 -- 172.21.15.57:0/2629824422 >> v1:172.21.15.57:6789/0 conn(0x7fc18410b730 legacy=0x7fc18419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc188e95700 1 -- 172.21.15.57:0/2629824422 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1841a93c0 con 0x7fc1840f5a00 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc188e95700 1 --2- 172.21.15.57:0/2629824422 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1840f5a00 0x7fc18410b100 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fc1840f47b0 tx=0x7fc17400b9d0).ready entity=mon.2 client_cookie=3a912cc237df3719 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc1837fe700 1 -- 172.21.15.57:0/2629824422 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc1841a93c0 con 0x7fc1840f5a00 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc1837fe700 1 -- 172.21.15.57:0/2629824422 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17400f970 con 0x7fc1840f5a00 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc1837fe700 1 -- 172.21.15.57:0/2629824422 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc174015070 con 0x7fc1840f5a00 2024-04-25T02:06:48.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc18c09a700 1 -- 172.21.15.57:0/2629824422 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1840f5a00 msgr2=0x7fc18410b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:48.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.642 7fc18c09a700 1 --2- 172.21.15.57:0/2629824422 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1840f5a00 0x7fc18410b100 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fc1840f47b0 tx=0x7fc17400b9d0).stop 2024-04-25T02:06:48.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.643 7fc18c09a700 1 -- 172.21.15.57:0/2629824422 shutdown_connections 2024-04-25T02:06:48.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.643 7fc18c09a700 1 --2- 172.21.15.57:0/2629824422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc18410bb80 0x7fc1841a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:48.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.643 7fc18c09a700 1 --2- 172.21.15.57:0/2629824422 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1840f5a00 0x7fc18410b100 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:48.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.643 7fc18c09a700 1 -- 172.21.15.57:0/2629824422 >> 172.21.15.57:0/2629824422 conn(0x7fc184113a60 msgr2=0x7fc1840f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:48.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.643 7fc18c09a700 1 -- 172.21.15.57:0/2629824422 shutdown_connections 2024-04-25T02:06:48.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.643 7fc18c09a700 1 -- 172.21.15.57:0/2629824422 wait complete. 2024-04-25T02:06:48.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.667 7fc18c09a700 1 Processor -- start 2024-04-25T02:06:48.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.667 7fc18c09a700 1 -- start start 2024-04-25T02:06:48.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.667 7fc18c09a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1841ad640 0x7fc1841ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:48.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc18c09a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1841ae0c0 0x7fc1840d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:48.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc18c09a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1840d3b20 0x7fc1841bb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:48.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc18c09a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840d5010 con 0x7fc1841ae0c0 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc18c09a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c3610 con 0x7fc1840d3b20 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc18c09a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c9cd0 con 0x7fc1841ad640 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc183fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1841ae0c0 0x7fc1840d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1841ad640 0x7fc1841ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc189696700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1840d3b20 0x7fc1841bb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1841ad640 0x7fc1841ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45052/0 (socket says 172.21.15.57:45052) 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc189696700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1840d3b20 0x7fc1841bb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40476/0 (socket says 172.21.15.57:40476) 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 -- 172.21.15.57:0/264575404 learned_addr learned my addr 172.21.15.57:0/264575404 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc183fff700 1 --2- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1841ae0c0 0x7fc1840d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47202/0 (socket says 172.21.15.57:47202) 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 -- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1840d3b20 msgr2=0x7fc1841bb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:48.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 --2- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1840d3b20 0x7fc1841bb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 -- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1841ae0c0 msgr2=0x7fc1840d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 --2- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1841ae0c0 0x7fc1840d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 -- 172.21.15.57:0/264575404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840d3f70 con 0x7fc1841ad640 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc188e95700 1 --2- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1841ad640 0x7fc1841ada90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc1840d67e0 tx=0x7fc1740068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc181ffb700 1 -- 172.21.15.57:0/264575404 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc1840d3f70 con 0x7fc1841ad640 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc181ffb700 1 -- 172.21.15.57:0/264575404 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174010a90 con 0x7fc1841ad640 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc18c09a700 1 -- 172.21.15.57:0/264575404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1840d4230 con 0x7fc1841ad640 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc181ffb700 1 -- 172.21.15.57:0/264575404 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc174021020 con 0x7fc1841ad640 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.668 7fc18c09a700 1 -- 172.21.15.57:0/264575404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1841bc100 con 0x7fc1841ad640 2024-04-25T02:06:48.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.669 7fc181ffb700 1 -- 172.21.15.57:0/264575404 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fc17401a480 con 0x7fc1841ad640 2024-04-25T02:06:48.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.669 7fc181ffb700 1 -- 172.21.15.57:0/264575404 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3237+0+0 (secure 0 0 0) 0x7fc17401e0d0 con 0x7fc1841ad640 2024-04-25T02:06:48.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.669 7fc18c09a700 1 -- 172.21.15.57:0/264575404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1840f08d0 con 0x7fc1841ad640 2024-04-25T02:06:48.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.673 7fc181ffb700 1 -- 172.21.15.57:0/264575404 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fc174010880 con 0x7fc1841ad640 2024-04-25T02:06:48.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:48.784 7fc18c09a700 1 -- 172.21.15.57:0/264575404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1841ae920 con 0x7fc1841ad640 2024-04-25T02:06:49.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.469 7fc181ffb700 1 -- 172.21.15.57:0/264575404 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc17400f570 con 0x7fc1841ad640 2024-04-25T02:06:49.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.474 7fc18c09a700 1 -- 172.21.15.57:0/264575404 >> v1:172.21.15.57:6816/43033 conn(0x7fc1680145b0 legacy=0x7fc168016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.474 7fc18c09a700 1 -- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1841ad640 msgr2=0x7fc1841ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.474 7fc18c09a700 1 --2- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1841ad640 0x7fc1841ada90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc1840d67e0 tx=0x7fc1740068c0).stop 2024-04-25T02:06:49.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.474 7fc18c09a700 1 -- 172.21.15.57:0/264575404 shutdown_connections 2024-04-25T02:06:49.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.474 7fc18c09a700 1 --2- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1840d3b20 0x7fc1841bb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:49.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.474 7fc18c09a700 1 --2- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc1841ad640 0x7fc1841ada90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:49.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.474 7fc18c09a700 1 --2- 172.21.15.57:0/264575404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1841ae0c0 0x7fc1840d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:49.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.474 7fc18c09a700 1 -- 172.21.15.57:0/264575404 >> 172.21.15.57:0/264575404 conn(0x7fc1840c6c70 msgr2=0x7fc1840df900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:49.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.475 7fc18c09a700 1 -- 172.21.15.57:0/264575404 shutdown_connections 2024-04-25T02:06:49.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.475 7fc18c09a700 1 -- 172.21.15.57:0/264575404 wait complete. 2024-04-25T02:06:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:06:49.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:06:49.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.633 7fad076f1700 1 Processor -- start 2024-04-25T02:06:49.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7fad076f1700 1 -- start start 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7fad076f1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad000f5910 0x7fad000f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7fad076f1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000f1eb0 0x7fad0010e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7fad076f1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000f9220 con 0x7fad000f2300 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7fad076f1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0010f0d0 con 0x7fad000f1eb0 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7fad076f1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad001ac670 con 0x7fad000f5910 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facfffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad000f5910 0x7fad000f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facff7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000f1eb0 0x7fad0010e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facfffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad000f5910 0x7fad000f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45064/0 (socket says 172.21.15.57:45064) 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facfffff700 1 -- 172.21.15.57:0/1793319695 learned_addr learned my addr 172.21.15.57:0/1793319695 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7fad04ced700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fad000f2300 0x7fad0010e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37826/0 (socket says 172.21.15.57:37826) 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facfffff700 1 -- 172.21.15.57:0/1793319695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000f1eb0 msgr2=0x7fad0010e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facfffff700 1 --2- 172.21.15.57:0/1793319695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000f1eb0 0x7fad0010e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:49.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facfffff700 1 -- 172.21.15.57:0/1793319695 >> v1:172.21.15.57:6789/0 conn(0x7fad000f2300 legacy=0x7fad0010e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facfffff700 1 -- 172.21.15.57:0/1793319695 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad001ac820 con 0x7fad000f5910 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facfeffd700 1 -- 172.21.15.57:0/1793319695 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288836785 0 0) 0x7facf8001490 con 0x7fad000f2300 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.634 7facff7fe700 1 --2- 172.21.15.57:0/1793319695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000f1eb0 0x7fad0010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7facfffff700 1 --2- 172.21.15.57:0/1793319695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad000f5910 0x7fad000f1880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7facf0002f70 tx=0x7facf0009a00).ready entity=mon.2 client_cookie=d155662b35faf0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7facfeffd700 1 -- 172.21.15.57:0/1793319695 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad001ac820 con 0x7fad000f5910 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7facfeffd700 1 -- 172.21.15.57:0/1793319695 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000f510 con 0x7fad000f5910 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7facfeffd700 1 -- 172.21.15.57:0/1793319695 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facf000f6f0 con 0x7fad000f5910 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7fad076f1700 1 -- 172.21.15.57:0/1793319695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad000f5910 msgr2=0x7fad000f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7fad076f1700 1 --2- 172.21.15.57:0/1793319695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad000f5910 0x7fad000f1880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7facf0002f70 tx=0x7facf0009a00).stop 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7fad076f1700 1 -- 172.21.15.57:0/1793319695 shutdown_connections 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7fad076f1700 1 --2- 172.21.15.57:0/1793319695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad000f5910 0x7fad000f1880 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7fad076f1700 1 --2- 172.21.15.57:0/1793319695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000f1eb0 0x7fad0010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7fad076f1700 1 -- 172.21.15.57:0/1793319695 >> 172.21.15.57:0/1793319695 conn(0x7fad00113a60 msgr2=0x7fad000f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7fad076f1700 1 -- 172.21.15.57:0/1793319695 shutdown_connections 2024-04-25T02:06:49.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.635 7fad076f1700 1 -- 172.21.15.57:0/1793319695 wait complete. 2024-04-25T02:06:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.659 7fad076f1700 1 Processor -- start 2024-04-25T02:06:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.659 7fad076f1700 1 -- start start 2024-04-25T02:06:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7fad076f1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad001b1ca0 0x7fad001b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7fad076f1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad000d6890 0x7fad000d6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7fad076f1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000d7310 0x7fad001bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7fad076f1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000f0140 con 0x7fad000d6890 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7fad076f1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad000caf20 con 0x7fad000d7310 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7fad076f1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad000bc890 con 0x7fad001b1ca0 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facfffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad001b1ca0 0x7fad001b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facfffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad001b1ca0 0x7fad001b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45066/0 (socket says 172.21.15.57:45066) 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7fad04ced700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000d7310 0x7fad001bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facfffff700 1 -- 172.21.15.57:0/3066527355 learned_addr learned my addr 172.21.15.57:0/3066527355 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facff7fe700 1 --2- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad000d6890 0x7fad000d6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facfffff700 1 -- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000d7310 msgr2=0x7fad001bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facfffff700 1 --2- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000d7310 0x7fad001bbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facfffff700 1 -- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad000d6890 msgr2=0x7fad000d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facfffff700 1 --2- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad000d6890 0x7fad000d6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.660 7facfffff700 1 -- 172.21.15.57:0/3066527355 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad000cb160 con 0x7fad001b1ca0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.661 7facfffff700 1 --2- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad001b1ca0 0x7fad001b20f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fad000c1430 tx=0x7facf00068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.661 7facfd7fa700 1 -- 172.21.15.57:0/3066527355 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fad000cb160 con 0x7fad001b1ca0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.661 7fad076f1700 1 -- 172.21.15.57:0/3066527355 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad000ca630 con 0x7fad001b1ca0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.661 7facfd7fa700 1 -- 172.21.15.57:0/3066527355 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0011710 con 0x7fad001b1ca0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.661 7facfd7fa700 1 -- 172.21.15.57:0/3066527355 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7facf0011ae0 con 0x7fad001b1ca0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.661 7fad076f1700 1 -- 172.21.15.57:0/3066527355 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad001bc570 con 0x7fad001b1ca0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.661 7facfd7fa700 1 -- 172.21.15.57:0/3066527355 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7facf0019030 con 0x7fad001b1ca0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.661 7facfd7fa700 1 -- 172.21.15.57:0/3066527355 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 2799+0+0 (secure 0 0 0) 0x7facf0018040 con 0x7fad001b1ca0 2024-04-25T02:06:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.662 7fad076f1700 1 -- 172.21.15.57:0/3066527355 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad000f08d0 con 0x7fad001b1ca0 2024-04-25T02:06:49.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.665 7facfd7fa700 1 -- 172.21.15.57:0/3066527355 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7facf0011500 con 0x7fad001b1ca0 2024-04-25T02:06:49.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:49.775 7fad076f1700 1 -- 172.21.15.57:0/3066527355 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad000e2f50 con 0x7fad001b1ca0 2024-04-25T02:06:50.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.483 7facfd7fa700 1 -- 172.21.15.57:0/3066527355 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7facf000f300 con 0x7fad001b1ca0 2024-04-25T02:06:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.496 7fad076f1700 1 -- 172.21.15.57:0/3066527355 >> v1:172.21.15.57:6816/43033 conn(0x7face40145b0 legacy=0x7face4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.496 7fad076f1700 1 -- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad001b1ca0 msgr2=0x7fad001b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.496 7fad076f1700 1 --2- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad001b1ca0 0x7fad001b20f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fad000c1430 tx=0x7facf00068c0).stop 2024-04-25T02:06:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.497 7fad076f1700 1 -- 172.21.15.57:0/3066527355 shutdown_connections 2024-04-25T02:06:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.497 7fad076f1700 1 --2- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fad000d7310 0x7fad001bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.497 7fad076f1700 1 --2- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fad001b1ca0 0x7fad001b20f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.497 7fad076f1700 1 --2- 172.21.15.57:0/3066527355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad000d6890 0x7fad000d6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.497 7fad076f1700 1 -- 172.21.15.57:0/3066527355 >> 172.21.15.57:0/3066527355 conn(0x7fad000dc960 msgr2=0x7fad000c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:50.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.501 7fad076f1700 1 -- 172.21.15.57:0/3066527355 shutdown_connections 2024-04-25T02:06:50.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.501 7fad076f1700 1 -- 172.21.15.57:0/3066527355 wait complete. 2024-04-25T02:06:50.510 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2024-04-25T02:06:50.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.656 7f1694cfb700 1 Processor -- start 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f1694cfb700 1 -- start start 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f1694cfb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900f59f0 0x7f169010b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f1694cfb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f169010b720 0x7f169019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f1694cfb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16901a0a50 con 0x7f169010bb70 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f1694cfb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16900fa570 con 0x7f169010b720 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f1694cfb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16901a0c70 con 0x7f16900f59f0 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168da8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900f59f0 0x7f169010b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168d28a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f169010b720 0x7f169019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168da8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900f59f0 0x7f169010b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40504/0 (socket says 172.21.15.57:40504) 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168e28c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f169010bb70 0x7f16901a0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37842/0 (socket says 172.21.15.57:37842) 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168da8b700 1 -- 172.21.15.57:0/1202840395 learned_addr learned my addr 172.21.15.57:0/1202840395 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168ca89700 1 -- 172.21.15.57:0/1202840395 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407096149 0 0) 0x7f1688001490 con 0x7f169010bb70 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168ca89700 1 -- 172.21.15.57:0/1202840395 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1670003270 con 0x7f169010bb70 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168da8b700 1 -- 172.21.15.57:0/1202840395 >> v2:172.21.15.57:3300/0 conn(0x7f169010b720 msgr2=0x7f169019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168da8b700 1 --2- 172.21.15.57:0/1202840395 >> v2:172.21.15.57:3300/0 conn(0x7f169010b720 0x7f169019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168da8b700 1 -- 172.21.15.57:0/1202840395 >> v1:172.21.15.57:6789/0 conn(0x7f169010bb70 legacy=0x7f16901a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.657 7f168da8b700 1 -- 172.21.15.57:0/1202840395 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16901a93b0 con 0x7f16900f59f0 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f168d28a700 1 --2- 172.21.15.57:0/1202840395 >> v2:172.21.15.57:3300/0 conn(0x7f169010b720 0x7f169019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f168da8b700 1 --2- 172.21.15.57:0/1202840395 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900f59f0 0x7f169010b0f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f1680002f70 tx=0x7f16800099d0).ready entity=mon.1 client_cookie=d212af48c91c6e13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f168ca89700 1 -- 172.21.15.57:0/1202840395 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16901a93b0 con 0x7f16900f59f0 2024-04-25T02:06:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f168ca89700 1 -- 172.21.15.57:0/1202840395 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168000f510 con 0x7f16900f59f0 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f168ca89700 1 -- 172.21.15.57:0/1202840395 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f168000f6f0 con 0x7f16900f59f0 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f1694cfb700 1 -- 172.21.15.57:0/1202840395 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900f59f0 msgr2=0x7f169010b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f1694cfb700 1 --2- 172.21.15.57:0/1202840395 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900f59f0 0x7f169010b0f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f1680002f70 tx=0x7f16800099d0).stop 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f1694cfb700 1 -- 172.21.15.57:0/1202840395 shutdown_connections 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f1694cfb700 1 --2- 172.21.15.57:0/1202840395 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900f59f0 0x7f169010b0f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f1694cfb700 1 --2- 172.21.15.57:0/1202840395 >> v2:172.21.15.57:3300/0 conn(0x7f169010b720 0x7f169019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.658 7f1694cfb700 1 -- 172.21.15.57:0/1202840395 >> 172.21.15.57:0/1202840395 conn(0x7f1690113a50 msgr2=0x7f16900f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.659 7f1694cfb700 1 -- 172.21.15.57:0/1202840395 shutdown_connections 2024-04-25T02:06:50.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.659 7f1694cfb700 1 -- 172.21.15.57:0/1202840395 wait complete. 2024-04-25T02:06:50.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f1694cfb700 1 Processor -- start 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f1694cfb700 1 -- start start 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f1694cfb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900e0050 0x7f16900d0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f1694cfb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16900d0c50 0x7f16901b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f1694cfb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f16900d10a0 0x7f16901b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f1694cfb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16900baec0 con 0x7f16900d0c50 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f1694cfb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16901b4cb0 con 0x7f16900e0050 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f1694cfb700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16901b4ee0 con 0x7f16900d10a0 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168da8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900e0050 0x7f16900d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168e28c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f16900d10a0 0x7f16901b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168d28a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16900d0c50 0x7f16901b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168da8b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900e0050 0x7f16900d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40520/0 (socket says 172.21.15.57:40520) 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168da8b700 1 -- 172.21.15.57:0/3606793494 learned_addr learned my addr 172.21.15.57:0/3606793494 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168d28a700 1 -- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f16900d10a0 msgr2=0x7f16901b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168d28a700 1 --2- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f16900d10a0 0x7f16901b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168d28a700 1 -- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900e0050 msgr2=0x7f16900d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168d28a700 1 --2- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900e0050 0x7f16900d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168d28a700 1 -- 172.21.15.57:0/3606793494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16901bb740 con 0x7f16900d0c50 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.683 7f168da8b700 1 --2- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900e0050 0x7f16900d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.684 7f168d28a700 1 --2- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16900d0c50 0x7f16901b4050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f167800a000 tx=0x7f167800d9b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.684 7f1686ffd700 1 -- 172.21.15.57:0/3606793494 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f16901bb740 con 0x7f16900d0c50 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.684 7f1686ffd700 1 -- 172.21.15.57:0/3606793494 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678011780 con 0x7f16900d0c50 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.684 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16901bb940 con 0x7f16900d0c50 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.684 7f1686ffd700 1 -- 172.21.15.57:0/3606793494 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f167800f040 con 0x7f16900d0c50 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.684 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16901bbb40 con 0x7f16900d0c50 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.684 7f1686ffd700 1 -- 172.21.15.57:0/3606793494 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1678011b50 con 0x7f16900d0c50 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.684 7f1686ffd700 1 -- 172.21.15.57:0/3606793494 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f1678010070 con 0x7f16900d0c50 2024-04-25T02:06:50.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.685 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16900f08c0 con 0x7f16900d0c50 2024-04-25T02:06:50.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.688 7f1686ffd700 1 -- 172.21.15.57:0/3606793494 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1678011380 con 0x7f16900d0c50 2024-04-25T02:06:50.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.799 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f16900ab8c0 con 0x7f16900d0c50 2024-04-25T02:06:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.807 7f1686ffd700 1 -- 172.21.15.57:0/3606793494 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1678000c30 con 0x7f16900d0c50 2024-04-25T02:06:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 >> v1:172.21.15.57:6816/43033 conn(0x7f16740145b0 legacy=0x7f1674016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16900d0c50 msgr2=0x7f16901b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 --2- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16900d0c50 0x7f16901b4050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f167800a000 tx=0x7f167800d9b0).stop 2024-04-25T02:06:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 shutdown_connections 2024-04-25T02:06:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 --2- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f16900d10a0 0x7f16901b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 --2- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16900e0050 0x7f16900d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 --2- 172.21.15.57:0/3606793494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16900d0c50 0x7f16901b4050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 >> 172.21.15.57:0/3606793494 conn(0x7f16900c5770 msgr2=0x7f16900d7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:50.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 shutdown_connections 2024-04-25T02:06:50.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.808 7f1694cfb700 1 -- 172.21.15.57:0/3606793494 wait complete. 2024-04-25T02:06:50.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr' 2024-04-25T02:06:50.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b9b59700 1 Processor -- start 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b9b59700 1 -- start start 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b9b59700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f19b410cb40 0x7f19b41a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b9b59700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b41a6be0 0x7f19b41a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b9b59700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b410cf90 con 0x7f19b40f5920 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b9b59700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40fa290 con 0x7f19b410cb40 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b9b59700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40f95c0 con 0x7f19b41a6be0 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b305e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b41a6be0 0x7f19b41a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b205c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f19b410cb40 0x7f19b41a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b285d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f19b40f5920 0x7f19b410c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37856/0 (socket says 172.21.15.57:37856) 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.953 7f19b285d700 1 -- 172.21.15.57:0/747898722 learned_addr learned my addr 172.21.15.57:0/747898722 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b205c700 1 -- 172.21.15.57:0/747898722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b41a6be0 msgr2=0x7f19b41a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b205c700 1 --2- 172.21.15.57:0/747898722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b41a6be0 0x7f19b41a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b205c700 1 -- 172.21.15.57:0/747898722 >> v1:172.21.15.57:6789/0 conn(0x7f19b40f5920 legacy=0x7f19b410c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b205c700 1 -- 172.21.15.57:0/747898722 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b41aa680 con 0x7f19b410cb40 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b185b700 1 -- 172.21.15.57:0/747898722 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606840492 0 0) 0x7f19a4001110 con 0x7f19b40f5920 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b205c700 1 --2- 172.21.15.57:0/747898722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b410cb40 0x7f19b41a65b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f19b4113400 tx=0x7f199c00ba20).ready entity=mon.0 client_cookie=f264fa36bd3e43ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b185b700 1 -- 172.21.15.57:0/747898722 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19b41aa680 con 0x7f19b410cb40 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b185b700 1 -- 172.21.15.57:0/747898722 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00d5c0 con 0x7f19b410cb40 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b185b700 1 -- 172.21.15.57:0/747898722 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f199c00d990 con 0x7f19b410cb40 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b9b59700 1 -- 172.21.15.57:0/747898722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b410cb40 msgr2=0x7f19b41a65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.954 7f19b9b59700 1 --2- 172.21.15.57:0/747898722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b410cb40 0x7f19b41a65b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f19b4113400 tx=0x7f199c00ba20).stop 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.955 7f19b9b59700 1 -- 172.21.15.57:0/747898722 shutdown_connections 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.955 7f19b9b59700 1 --2- 172.21.15.57:0/747898722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b41a6be0 0x7f19b41a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.955 7f19b9b59700 1 --2- 172.21.15.57:0/747898722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b410cb40 0x7f19b41a65b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.955 7f19b9b59700 1 -- 172.21.15.57:0/747898722 >> 172.21.15.57:0/747898722 conn(0x7f19b4113a70 msgr2=0x7f19b40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.955 7f19b9b59700 1 -- 172.21.15.57:0/747898722 shutdown_connections 2024-04-25T02:06:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.955 7f19b9b59700 1 -- 172.21.15.57:0/747898722 wait complete. 2024-04-25T02:06:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b9b59700 1 Processor -- start 2024-04-25T02:06:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b9b59700 1 -- start start 2024-04-25T02:06:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b9b59700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b40d3810 0x7f19b40d3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b9b59700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b40d4290 0x7f19b41b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b9b59700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19b41b4f20 0x7f19b41b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b9b59700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40f0250 con 0x7f19b40d3810 2024-04-25T02:06:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b9b59700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40db3f0 con 0x7f19b40d4290 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b9b59700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40e0770 con 0x7f19b41b4f20 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b285d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b40d3810 0x7f19b40d3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b205c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b40d4290 0x7f19b41b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b285d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b40d3810 0x7f19b40d3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47240/0 (socket says 172.21.15.57:47240) 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.979 7f19b285d700 1 -- 172.21.15.57:0/3257359751 learned_addr learned my addr 172.21.15.57:0/3257359751 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b305e700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19b41b4f20 0x7f19b41b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b285d700 1 -- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19b41b4f20 msgr2=0x7f19b41b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b285d700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19b41b4f20 0x7f19b41b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b285d700 1 -- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b40d4290 msgr2=0x7f19b41b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b285d700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b40d4290 0x7f19b41b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b285d700 1 -- 172.21.15.57:0/3257359751 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b40db080 con 0x7f19b40d3810 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b205c700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b40d4290 0x7f19b41b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b285d700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b40d3810 0x7f19b40d3c60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f19b40d6b90 tx=0x7f19a400c860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19abfff700 1 -- 172.21.15.57:0/3257359751 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19b40db080 con 0x7f19b40d3810 2024-04-25T02:06:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19abfff700 1 -- 172.21.15.57:0/3257359751 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a40072e0 con 0x7f19b40d3810 2024-04-25T02:06:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b40dbad0 con 0x7f19b40d3810 2024-04-25T02:06:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19abfff700 1 -- 172.21.15.57:0/3257359751 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19a4005810 con 0x7f19b40d3810 2024-04-25T02:06:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.980 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b41bc240 con 0x7f19b40d3810 2024-04-25T02:06:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.981 7f19abfff700 1 -- 172.21.15.57:0/3257359751 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f19a4005a10 con 0x7f19b40d3810 2024-04-25T02:06:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.981 7f19abfff700 1 -- 172.21.15.57:0/3257359751 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f19a40146e0 con 0x7f19b40d3810 2024-04-25T02:06:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.981 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b40f08e0 con 0x7f19b40d3810 2024-04-25T02:06:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:50.984 7f19abfff700 1 -- 172.21.15.57:0/3257359751 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f19a40070d0 con 0x7f19b40d3810 2024-04-25T02:06:51.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.131 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr"]} v 0) v1 -- 0x7f19b41af010 con 0x7f19b40d3810 2024-04-25T02:06:51.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.500 7f19abfff700 1 -- 172.21.15.57:0/3257359751 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_newops.TestNewOps.test_newops_getvxattr"]}]=0 v70) v1 ==== 136+0+0 (secure 0 0 0) 0x7f19a4000c30 con 0x7f19b40d3810 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 >> v1:172.21.15.57:6816/43033 conn(0x7f19980145b0 legacy=0x7f1998016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b40d3810 msgr2=0x7f19b40d3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b40d3810 0x7f19b40d3c60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f19b40d6b90 tx=0x7f19a400c860).stop 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 shutdown_connections 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19b41b4f20 0x7f19b41b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19b40d3810 0x7f19b40d3c60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 --2- 172.21.15.57:0/3257359751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19b40d4290 0x7f19b41b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 >> 172.21.15.57:0/3257359751 conn(0x7f19b40c4a00 msgr2=0x7f19b40d9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 shutdown_connections 2024-04-25T02:06:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.502 7f19b9b59700 1 -- 172.21.15.57:0/3257359751 wait complete. 2024-04-25T02:06:51.521 INFO:tasks.cephfs_test_runner:For nautilus it will crash the MDSs when receive unknown OPs, as a workaround ... ok 2024-04-25T02:06:51.521 INFO:tasks.cephfs_test_runner: 2024-04-25T02:06:51.521 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T02:06:51.522 INFO:tasks.cephfs_test_runner:Ran 1 test in 38.382s 2024-04-25T02:06:51.522 INFO:tasks.cephfs_test_runner: 2024-04-25T02:06:51.522 INFO:tasks.cephfs_test_runner:OK 2024-04-25T02:06:51.522 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T02:06:51.531 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T02:06:51.540 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T02:06:51.540 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-25T02:06:51.540 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:06:51.591 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343252k,nr_inodes=4085813,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2024-04-25T02:06:51.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:51.591 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-25T02:06:51.638 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:06:51.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:51.639 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:06:51.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:06:51.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-04-25T02:06:51.829 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T02:06:51.839 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:06:51.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:51.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff84b3df700 1 Processor -- start 2024-04-25T02:06:51.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff84b3df700 1 -- start start 2024-04-25T02:06:51.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff84b3df700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440f5a10 0x7ff84410b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:51.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff84b3df700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff84410b740 0x7ff84419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:51.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff84b3df700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff84410bb90 0x7ff8441a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:51.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff84b3df700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440fa590 con 0x7ff84410b740 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff84b3df700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8441a08a0 con 0x7ff8440f5a10 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff84b3df700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8441a0ad0 con 0x7ff84410bb90 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff843fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440f5a10 0x7ff84410b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff8489db700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff84410bb90 0x7ff8441a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff8437fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff84410b740 0x7ff84419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff843fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440f5a10 0x7ff84410b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40546/0 (socket says 172.21.15.57:40546) 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.979 7ff843fff700 1 -- 172.21.15.57:0/1630758127 learned_addr learned my addr 172.21.15.57:0/1630758127 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff8489db700 1 -- 172.21.15.57:0/1630758127 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440f5a10 msgr2=0x7ff84410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff8489db700 1 --2- 172.21.15.57:0/1630758127 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440f5a10 0x7ff84410b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff8489db700 1 -- 172.21.15.57:0/1630758127 >> v2:172.21.15.57:3300/0 conn(0x7ff84410b740 msgr2=0x7ff84419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff8489db700 1 --2- 172.21.15.57:0/1630758127 >> v2:172.21.15.57:3300/0 conn(0x7ff84410b740 0x7ff84419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff8489db700 1 -- 172.21.15.57:0/1630758127 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8441a73b0 con 0x7ff84410bb90 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff8437fe700 1 --2- 172.21.15.57:0/1630758127 >> v2:172.21.15.57:3300/0 conn(0x7ff84410b740 0x7ff84419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:51.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff8489db700 1 --2- 172.21.15.57:0/1630758127 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff84410bb90 0x7ff8441a0270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff8440f47c0 tx=0x7ff83c009cc0).ready entity=mon.2 client_cookie=904eefc89b874906 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff842ffd700 1 -- 172.21.15.57:0/1630758127 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff8441a73b0 con 0x7ff84410bb90 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff842ffd700 1 -- 172.21.15.57:0/1630758127 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c00b840 con 0x7ff84410bb90 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff842ffd700 1 -- 172.21.15.57:0/1630758127 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff83c00ba20 con 0x7ff84410bb90 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff84b3df700 1 -- 172.21.15.57:0/1630758127 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff84410bb90 msgr2=0x7ff8441a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff84b3df700 1 --2- 172.21.15.57:0/1630758127 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff84410bb90 0x7ff8441a0270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff8440f47c0 tx=0x7ff83c009cc0).stop 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.980 7ff84b3df700 1 -- 172.21.15.57:0/1630758127 shutdown_connections 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.981 7ff84b3df700 1 --2- 172.21.15.57:0/1630758127 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff84410bb90 0x7ff8441a0270 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.981 7ff84b3df700 1 --2- 172.21.15.57:0/1630758127 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440f5a10 0x7ff84410b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.981 7ff84b3df700 1 --2- 172.21.15.57:0/1630758127 >> v2:172.21.15.57:3300/0 conn(0x7ff84410b740 0x7ff84419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.981 7ff84b3df700 1 -- 172.21.15.57:0/1630758127 >> 172.21.15.57:0/1630758127 conn(0x7ff844113a70 msgr2=0x7ff8440f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.981 7ff84b3df700 1 -- 172.21.15.57:0/1630758127 shutdown_connections 2024-04-25T02:06:51.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:51.981 7ff84b3df700 1 -- 172.21.15.57:0/1630758127 wait complete. 2024-04-25T02:06:52.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff84b3df700 1 Processor -- start 2024-04-25T02:06:52.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff84b3df700 1 -- start start 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff84b3df700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440df310 0x7ff8440d3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff84b3df700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8440d36a0 0x7ff8441b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff84b3df700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440d3af0 0x7ff8441b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff84b3df700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440db430 con 0x7ff8440df310 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff84b3df700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440d4200 con 0x7ff8440d3af0 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff84b3df700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440db780 con 0x7ff8440d36a0 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff843fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440df310 0x7ff8440d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff8437fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8440d36a0 0x7ff8441b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff8489db700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440d3af0 0x7ff8441b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff843fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440df310 0x7ff8440d3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47266/0 (socket says 172.21.15.57:47266) 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff843fff700 1 -- 172.21.15.57:0/849392928 learned_addr learned my addr 172.21.15.57:0/849392928 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.005 7ff8437fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8440d36a0 0x7ff8441b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45104/0 (socket says 172.21.15.57:45104) 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8437fe700 1 -- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440d3af0 msgr2=0x7ff8441b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8437fe700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440d3af0 0x7ff8441b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8437fe700 1 -- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440df310 msgr2=0x7ff8440d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8437fe700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440df310 0x7ff8440d3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8437fe700 1 -- 172.21.15.57:0/849392928 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8441b53f0 con 0x7ff8440d36a0 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8489db700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440d3af0 0x7ff8441b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff843fff700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440df310 0x7ff8440d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8437fe700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8440d36a0 0x7ff8441b4790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7ff8440d67c0 tx=0x7ff82c00ec80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8417fa700 1 -- 172.21.15.57:0/849392928 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff8441b53f0 con 0x7ff8440d36a0 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8417fa700 1 -- 172.21.15.57:0/849392928 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00c810 con 0x7ff8440d36a0 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff84b3df700 1 -- 172.21.15.57:0/849392928 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8441b5710 con 0x7ff8440d36a0 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8417fa700 1 -- 172.21.15.57:0/849392928 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff82c00f040 con 0x7ff8440d36a0 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff84b3df700 1 -- 172.21.15.57:0/849392928 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8441bc060 con 0x7ff8440d36a0 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.006 7ff8417fa700 1 -- 172.21.15.57:0/849392928 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff82c011070 con 0x7ff8440d36a0 2024-04-25T02:06:52.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.007 7ff8417fa700 1 -- 172.21.15.57:0/849392928 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7ff82c010040 con 0x7ff8440d36a0 2024-04-25T02:06:52.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.007 7ff84b3df700 1 -- 172.21.15.57:0/849392928 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8440f08e0 con 0x7ff8440d36a0 2024-04-25T02:06:52.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.010 7ff8417fa700 1 -- 172.21.15.57:0/849392928 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7ff82c00edc0 con 0x7ff8440d36a0 2024-04-25T02:06:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.116 7ff84b3df700 1 -- 172.21.15.57:0/849392928 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7ff844087810 con 0x7ff8280145b0 2024-04-25T02:06:52.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.118 7ff8417fa700 1 -- 172.21.15.57:0/849392928 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32492 (unknown 2965378022 0 1818130743) 0x7ff83400bc50 con 0x7ff8280145b0 2024-04-25T02:06:52.124 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 -- 172.21.15.57:0/849392928 >> v1:172.21.15.57:6816/43033 conn(0x7ff8280145b0 legacy=0x7ff828016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 -- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8440d36a0 msgr2=0x7ff8441b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8440d36a0 0x7ff8441b4790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7ff8440d67c0 tx=0x7ff82c00ec80).stop 2024-04-25T02:06:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 -- 172.21.15.57:0/849392928 shutdown_connections 2024-04-25T02:06:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff8440d3af0 0x7ff8441b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff8440df310 0x7ff8440d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 --2- 172.21.15.57:0/849392928 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff8440d36a0 0x7ff8441b4790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 -- 172.21.15.57:0/849392928 >> 172.21.15.57:0/849392928 conn(0x7ff8440c4980 msgr2=0x7ff8441a10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 -- 172.21.15.57:0/849392928 shutdown_connections 2024-04-25T02:06:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.119 7ff84b3df700 1 -- 172.21.15.57:0/849392928 wait complete. 2024-04-25T02:06:52.127 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:52.136 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-04-25 02:06:50.679147","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195304,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292056,"statfs":{"total":386547056640,"available":382251065344,"internally_reserved":4294967296,"allocated":991232,"data_stored":305438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.786969"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.304393","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:47.304393","last_peered":"2024-04-25 02:06:47.304393","last_clean":"2024-04-25 02:06:47.304393","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:47.304393","last_undegraded":"2024-04-25 02:06:47.304393","last_fullsized":"2024-04-25 02:06:47.304393","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.557661","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:33.557661","last_peered":"2024-04-25 02:06:33.557661","last_clean":"2024-04-25 02:06:33.557661","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:33.557661","last_undegraded":"2024-04-25 02:06:33.557661","last_fullsized":"2024-04-25 02:06:33.557661","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.300953","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:47.300953","last_peered":"2024-04-25 02:06:47.300953","last_clean":"2024-04-25 02:06:47.300953","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:47.300953","last_undegraded":"2024-04-25 02:06:47.300953","last_fullsized":"2024-04-25 02:06:47.300953","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.302631","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:47.302631","last_peered":"2024-04-25 02:06:47.302631","last_clean":"2024-04-25 02:06:47.302631","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:47.302631","last_undegraded":"2024-04-25 02:06:47.302631","last_fullsized":"2024-04-25 02:06:47.302631","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.300538","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:47.300538","last_peered":"2024-04-25 02:06:47.300538","last_clean":"2024-04-25 02:06:47.300538","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:47.300538","last_undegraded":"2024-04-25 02:06:47.300538","last_fullsized":"2024-04-25 02:06:47.300538","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.558047","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:33.558047","last_peered":"2024-04-25 02:06:33.558047","last_clean":"2024-04-25 02:06:33.558047","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:33.558047","last_undegraded":"2024-04-25 02:06:33.558047","last_fullsized":"2024-04-25 02:06:33.558047","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.557718","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:33.557718","last_peered":"2024-04-25 02:06:33.557718","last_clean":"2024-04-25 02:06:33.557718","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:33.557718","last_undegraded":"2024-04-25 02:06:33.557718","last_fullsized":"2024-04-25 02:06:33.557718","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.301597","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:47.301597","last_peered":"2024-04-25 02:06:47.301597","last_clean":"2024-04-25 02:06:47.301597","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:47.301597","last_undegraded":"2024-04-25 02:06:47.301597","last_fullsized":"2024-04-25 02:06:47.301597","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705681,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":79173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.224}]},{"osd":1,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.31},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.23400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":78427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":3.2770000000000001,"5min":3.2770000000000001,"15min":3.2770000000000001},"last":0.22800000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.4260000000000002,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":6.2469999999999999,"5min":6.2469999999999999,"15min":6.2469999999999999},"last":0.251}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.26400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":73636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.317}]},{"osd":2,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.218}]},{"osd":3,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.23400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":74202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.246}]},{"osd":2,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.316}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.32500000000000001}]}]}]}} 2024-04-25T02:06:52.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.262 7f284d89a700 1 Processor -- start 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.262 7f284d89a700 1 -- start start 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f284d89a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f284810b890 0x7f28481a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f284d89a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f28481a5950 0x7f28481a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f284d89a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284810bce0 con 0x7f28480f5990 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f284d89a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28480fa510 con 0x7f28481a5950 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f284d89a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28481a0bd0 con 0x7f284810b890 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f28465c5700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f28480f5990 0x7f284810b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37872/0 (socket says 172.21.15.57:37872) 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f28465c5700 1 -- 172.21.15.57:0/2713215773 learned_addr learned my addr 172.21.15.57:0/2713215773 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f2845dc4700 1 --2- 172.21.15.57:0/2713215773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f284810b890 0x7f28481a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f2846dc6700 1 --2- 172.21.15.57:0/2713215773 >> v2:172.21.15.57:3300/0 conn(0x7f28481a5950 0x7f28481a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f2845dc4700 1 -- 172.21.15.57:0/2713215773 >> v2:172.21.15.57:3300/0 conn(0x7f28481a5950 msgr2=0x7f28481a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f2845dc4700 1 --2- 172.21.15.57:0/2713215773 >> v2:172.21.15.57:3300/0 conn(0x7f28481a5950 0x7f28481a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f2845dc4700 1 -- 172.21.15.57:0/2713215773 >> v1:172.21.15.57:6789/0 conn(0x7f28480f5990 legacy=0x7f284810b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f2845dc4700 1 -- 172.21.15.57:0/2713215773 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28481a93f0 con 0x7f284810b890 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f2846dc6700 1 --2- 172.21.15.57:0/2713215773 >> v2:172.21.15.57:3300/0 conn(0x7f28481a5950 0x7f28481a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.263 7f2845dc4700 1 --2- 172.21.15.57:0/2713215773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f284810b890 0x7f28481a5320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2848103990 tx=0x7f283c00b9a0).ready entity=mon.1 client_cookie=591a4791b439c833 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f28455c3700 1 -- 172.21.15.57:0/2713215773 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f28481a93f0 con 0x7f284810b890 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f28455c3700 1 -- 172.21.15.57:0/2713215773 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c00d5c0 con 0x7f284810b890 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f28455c3700 1 -- 172.21.15.57:0/2713215773 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f283c00d990 con 0x7f284810b890 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f284d89a700 1 -- 172.21.15.57:0/2713215773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f284810b890 msgr2=0x7f28481a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f284d89a700 1 --2- 172.21.15.57:0/2713215773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f284810b890 0x7f28481a5320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2848103990 tx=0x7f283c00b9a0).stop 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f284d89a700 1 -- 172.21.15.57:0/2713215773 shutdown_connections 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f284d89a700 1 --2- 172.21.15.57:0/2713215773 >> v2:172.21.15.57:3300/0 conn(0x7f28481a5950 0x7f28481a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f284d89a700 1 --2- 172.21.15.57:0/2713215773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f284810b890 0x7f28481a5320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f284d89a700 1 -- 172.21.15.57:0/2713215773 >> 172.21.15.57:0/2713215773 conn(0x7f28481139f0 msgr2=0x7f28480f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f284d89a700 1 -- 172.21.15.57:0/2713215773 shutdown_connections 2024-04-25T02:06:52.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.264 7f284d89a700 1 -- 172.21.15.57:0/2713215773 wait complete. 2024-04-25T02:06:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.288 7f284d89a700 1 Processor -- start 2024-04-25T02:06:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.288 7f284d89a700 1 -- start start 2024-04-25T02:06:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f284d89a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f28480ca0e0 0x7f28480d53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f284d89a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28480d59f0 0x7f28481afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f284d89a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28480d5e40 0x7f28481b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f284d89a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848088da0 con 0x7f28480d59f0 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f284d89a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28480ccd10 con 0x7f28480d5e40 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f284d89a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28480cc0c0 con 0x7f28480ca0e0 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f28465c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f28480ca0e0 0x7f28480d53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2845dc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28480d59f0 0x7f28481afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2846dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28480d5e40 0x7f28481b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2846dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28480d5e40 0x7f28481b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40564/0 (socket says 172.21.15.57:40564) 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f28465c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f28480ca0e0 0x7f28480d53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45114/0 (socket says 172.21.15.57:45114) 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2845dc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28480d59f0 0x7f28481afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47290/0 (socket says 172.21.15.57:47290) 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2846dc6700 1 -- 172.21.15.57:0/1054685890 learned_addr learned my addr 172.21.15.57:0/1054685890 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2845dc4700 1 -- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f28480ca0e0 msgr2=0x7f28480d53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2845dc4700 1 --2- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f28480ca0e0 0x7f28480d53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2845dc4700 1 -- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28480d5e40 msgr2=0x7f28481b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2845dc4700 1 --2- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28480d5e40 0x7f28481b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.289 7f2845dc4700 1 -- 172.21.15.57:0/1054685890 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848088f50 con 0x7f28480d59f0 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f2846dc6700 1 --2- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28480d5e40 0x7f28481b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f2845dc4700 1 --2- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28480d59f0 0x7f28481afe80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f28480c3ed0 tx=0x7f283c0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f28377fe700 1 -- 172.21.15.57:0/1054685890 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2848088f50 con 0x7f28480d59f0 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f28377fe700 1 -- 172.21.15.57:0/1054685890 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c0119c0 con 0x7f28480d59f0 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f28377fe700 1 -- 172.21.15.57:0/1054685890 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f283c011d90 con 0x7f28480d59f0 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f284d89a700 1 -- 172.21.15.57:0/1054685890 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28481b0ae0 con 0x7f28480d59f0 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f284d89a700 1 -- 172.21.15.57:0/1054685890 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28481b0f20 con 0x7f28480d59f0 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f28377fe700 1 -- 172.21.15.57:0/1054685890 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f283c027460 con 0x7f28480d59f0 2024-04-25T02:06:52.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.290 7f28377fe700 1 -- 172.21.15.57:0/1054685890 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f283c02bb50 con 0x7f28480d59f0 2024-04-25T02:06:52.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.291 7f284d89a700 1 -- 172.21.15.57:0/1054685890 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28480f0860 con 0x7f28480d59f0 2024-04-25T02:06:52.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.294 7f28377fe700 1 -- 172.21.15.57:0/1054685890 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f283c00d3b0 con 0x7f28480d59f0 2024-04-25T02:06:52.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.401 7f284d89a700 1 -- 172.21.15.57:0/1054685890 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f28480e6630 con 0x7f28240145b0 2024-04-25T02:06:52.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.402 7f28377fe700 1 -- 172.21.15.57:0/1054685890 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32492 (unknown 2965378022 0 1818130743) 0x7f28480e6630 con 0x7f28240145b0 2024-04-25T02:06:52.409 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 -- 172.21.15.57:0/1054685890 >> v1:172.21.15.57:6816/43033 conn(0x7f28240145b0 legacy=0x7f2824016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 -- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28480d59f0 msgr2=0x7f28481afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 --2- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28480d59f0 0x7f28481afe80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f28480c3ed0 tx=0x7f283c0068c0).stop 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 -- 172.21.15.57:0/1054685890 shutdown_connections 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 --2- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28480d5e40 0x7f28481b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 --2- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f28480ca0e0 0x7f28480d53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 --2- 172.21.15.57:0/1054685890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28480d59f0 0x7f28481afe80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 -- 172.21.15.57:0/1054685890 >> 172.21.15.57:0/1054685890 conn(0x7f28480c7f20 msgr2=0x7f28480c6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 -- 172.21.15.57:0/1054685890 shutdown_connections 2024-04-25T02:06:52.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.404 7f284d89a700 1 -- 172.21.15.57:0/1054685890 wait complete. 2024-04-25T02:06:52.411 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:52.420 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-04-25 02:06:50.679147","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195304,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292056,"statfs":{"total":386547056640,"available":382251065344,"internally_reserved":4294967296,"allocated":991232,"data_stored":305438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.786969"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.304393","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:47.304393","last_peered":"2024-04-25 02:06:47.304393","last_clean":"2024-04-25 02:06:47.304393","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:47.304393","last_undegraded":"2024-04-25 02:06:47.304393","last_fullsized":"2024-04-25 02:06:47.304393","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.557661","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:33.557661","last_peered":"2024-04-25 02:06:33.557661","last_clean":"2024-04-25 02:06:33.557661","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:33.557661","last_undegraded":"2024-04-25 02:06:33.557661","last_fullsized":"2024-04-25 02:06:33.557661","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.300953","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:47.300953","last_peered":"2024-04-25 02:06:47.300953","last_clean":"2024-04-25 02:06:47.300953","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:47.300953","last_undegraded":"2024-04-25 02:06:47.300953","last_fullsized":"2024-04-25 02:06:47.300953","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.302631","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:47.302631","last_peered":"2024-04-25 02:06:47.302631","last_clean":"2024-04-25 02:06:47.302631","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:47.302631","last_undegraded":"2024-04-25 02:06:47.302631","last_fullsized":"2024-04-25 02:06:47.302631","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.300538","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:47.300538","last_peered":"2024-04-25 02:06:47.300538","last_clean":"2024-04-25 02:06:47.300538","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:47.300538","last_undegraded":"2024-04-25 02:06:47.300538","last_fullsized":"2024-04-25 02:06:47.300538","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.558047","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:33.558047","last_peered":"2024-04-25 02:06:33.558047","last_clean":"2024-04-25 02:06:33.558047","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:33.558047","last_undegraded":"2024-04-25 02:06:33.558047","last_fullsized":"2024-04-25 02:06:33.558047","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.557718","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:33.557718","last_peered":"2024-04-25 02:06:33.557718","last_clean":"2024-04-25 02:06:33.557718","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:33.557718","last_undegraded":"2024-04-25 02:06:33.557718","last_fullsized":"2024-04-25 02:06:33.557718","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.301597","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:47.301597","last_peered":"2024-04-25 02:06:47.301597","last_clean":"2024-04-25 02:06:47.301597","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:47.301597","last_undegraded":"2024-04-25 02:06:47.301597","last_fullsized":"2024-04-25 02:06:47.301597","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705681,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":79173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.224}]},{"osd":1,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.31},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.23400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":78427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":3.2770000000000001,"5min":3.2770000000000001,"15min":3.2770000000000001},"last":0.22800000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.4260000000000002,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":6.2469999999999999,"5min":6.2469999999999999,"15min":6.2469999999999999},"last":0.251}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.26400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":73636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.317}]},{"osd":2,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.218}]},{"osd":3,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.23400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":74202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.246}]},{"osd":2,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.316}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.32500000000000001}]}]}]}} 2024-04-25T02:06:52.421 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:06:52.422 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:52.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.548 7f407bd7e700 1 Processor -- start 2024-04-25T02:06:52.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.548 7f407bd7e700 1 -- start start 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.548 7f407bd7e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f407410b910 0x7f40741a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.548 7f407bd7e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40741a59d0 0x7f40741a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.548 7f407bd7e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407410bd60 con 0x7f40740f5a10 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.548 7f407bd7e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40740fa590 con 0x7f40741a59d0 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.548 7f407bd7e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40741a0c50 con 0x7f407410b910 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f4073fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f407410b910 0x7f40741a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f4078b79700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f40740f5a10 0x7f407410b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37878/0 (socket says 172.21.15.57:37878) 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f407937a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40741a59d0 0x7f40741a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f4078b79700 1 -- 172.21.15.57:0/4137436172 learned_addr learned my addr 172.21.15.57:0/4137436172 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:52.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f40737fe700 1 -- 172.21.15.57:0/4137436172 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863002741 0 0) 0x7f406c001490 con 0x7f40740f5a10 2024-04-25T02:06:52.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f4073fff700 1 -- 172.21.15.57:0/4137436172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40741a59d0 msgr2=0x7f40741a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:52.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f4073fff700 1 --2- 172.21.15.57:0/4137436172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40741a59d0 0x7f40741a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f4073fff700 1 -- 172.21.15.57:0/4137436172 >> v1:172.21.15.57:6789/0 conn(0x7f40740f5a10 legacy=0x7f407410b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f4073fff700 1 -- 172.21.15.57:0/4137436172 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40741a9470 con 0x7f407410b910 2024-04-25T02:06:52.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f407937a700 1 --2- 172.21.15.57:0/4137436172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40741a59d0 0x7f40741a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f4073fff700 1 --2- 172.21.15.57:0/4137436172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f407410b910 0x7f40741a53a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f40740f47c0 tx=0x7f405c00b9d0).ready entity=mon.2 client_cookie=780e9fc82fff8cda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f40737fe700 1 -- 172.21.15.57:0/4137436172 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40741a9470 con 0x7f407410b910 2024-04-25T02:06:52.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f40737fe700 1 -- 172.21.15.57:0/4137436172 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c00d570 con 0x7f407410b910 2024-04-25T02:06:52.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f40737fe700 1 -- 172.21.15.57:0/4137436172 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f405c00d940 con 0x7f407410b910 2024-04-25T02:06:52.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f407bd7e700 1 -- 172.21.15.57:0/4137436172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f407410b910 msgr2=0x7f40741a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.549 7f407bd7e700 1 --2- 172.21.15.57:0/4137436172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f407410b910 0x7f40741a53a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f40740f47c0 tx=0x7f405c00b9d0).stop 2024-04-25T02:06:52.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.550 7f407bd7e700 1 -- 172.21.15.57:0/4137436172 shutdown_connections 2024-04-25T02:06:52.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.550 7f407bd7e700 1 --2- 172.21.15.57:0/4137436172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40741a59d0 0x7f40741a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.550 7f407bd7e700 1 --2- 172.21.15.57:0/4137436172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f407410b910 0x7f40741a53a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.550 7f407bd7e700 1 -- 172.21.15.57:0/4137436172 >> 172.21.15.57:0/4137436172 conn(0x7f4074113a70 msgr2=0x7f40740f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.550 7f407bd7e700 1 -- 172.21.15.57:0/4137436172 shutdown_connections 2024-04-25T02:06:52.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.550 7f407bd7e700 1 -- 172.21.15.57:0/4137436172 wait complete. 2024-04-25T02:06:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.574 7f407bd7e700 1 Processor -- start 2024-04-25T02:06:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.574 7f407bd7e700 1 -- start start 2024-04-25T02:06:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.574 7f407bd7e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40740ce290 0x7f40740d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.574 7f407bd7e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f40740da390 0x7f40741b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.574 7f407bd7e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40740da7e0 0x7f40741b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.574 7f407bd7e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40740cdc30 con 0x7f40740da7e0 2024-04-25T02:06:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.574 7f407bd7e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40741b5390 con 0x7f40740ce290 2024-04-25T02:06:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.574 7f407bd7e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40741b55c0 con 0x7f40740da390 2024-04-25T02:06:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4078b79700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40740ce290 0x7f40740d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4073fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f40740da390 0x7f40741b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f407937a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40740da7e0 0x7f40741b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4078b79700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40740ce290 0x7f40740d9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40580/0 (socket says 172.21.15.57:40580) 2024-04-25T02:06:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4078b79700 1 -- 172.21.15.57:0/1012248814 learned_addr learned my addr 172.21.15.57:0/1012248814 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:52.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4073fff700 1 -- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40740ce290 msgr2=0x7f40740d9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4073fff700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40740ce290 0x7f40740d9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4073fff700 1 -- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40740da7e0 msgr2=0x7f40741b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4073fff700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40740da7e0 0x7f40741b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4073fff700 1 -- 172.21.15.57:0/1012248814 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40741bbf30 con 0x7f40740da390 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4078b79700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40740ce290 0x7f40740d9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f407937a700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40740da7e0 0x7f40741b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4073fff700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f40740da390 0x7f40741b4730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f40740f47c0 tx=0x7f405c0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4071ffb700 1 -- 172.21.15.57:0/1012248814 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f40741bbf30 con 0x7f40740da390 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4071ffb700 1 -- 172.21.15.57:0/1012248814 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c011860 con 0x7f40740da390 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40741bc130 con 0x7f40740da390 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f4071ffb700 1 -- 172.21.15.57:0/1012248814 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f405c011c30 con 0x7f40740da390 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.575 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40741bc510 con 0x7f40740da390 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.576 7f4071ffb700 1 -- 172.21.15.57:0/1012248814 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f405c024060 con 0x7f40740da390 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.576 7f4071ffb700 1 -- 172.21.15.57:0/1012248814 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f405c020b10 con 0x7f40740da390 2024-04-25T02:06:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.576 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40740f08e0 con 0x7f40740da390 2024-04-25T02:06:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.580 7f4071ffb700 1 -- 172.21.15.57:0/1012248814 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f405c011650 con 0x7f40740da390 2024-04-25T02:06:52.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.688 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f4074087810 con 0x7f40580145b0 2024-04-25T02:06:52.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.689 7f4071ffb700 1 -- 172.21.15.57:0/1012248814 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32492 (unknown 2965378022 0 598652272) 0x7f406c001c90 con 0x7f40580145b0 2024-04-25T02:06:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:52.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 >> v1:172.21.15.57:6816/43033 conn(0x7f40580145b0 legacy=0x7f4058016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f40740da390 msgr2=0x7f40741b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f40740da390 0x7f40741b4730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f40740f47c0 tx=0x7f405c0068c0).stop 2024-04-25T02:06:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 shutdown_connections 2024-04-25T02:06:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40740da7e0 0x7f40741b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f40740ce290 0x7f40740d9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 --2- 172.21.15.57:0/1012248814 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f40740da390 0x7f40741b4730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 >> 172.21.15.57:0/1012248814 conn(0x7f40740c5c60 msgr2=0x7f40740d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 shutdown_connections 2024-04-25T02:06:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.690 7f407bd7e700 1 -- 172.21.15.57:0/1012248814 wait complete. 2024-04-25T02:06:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:52.707 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-25 02:06:52.679388","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195304,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292056,"statfs":{"total":386547056640,"available":382251065344,"internally_reserved":4294967296,"allocated":991232,"data_stored":305438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.786969"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.304393","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:47.304393","last_peered":"2024-04-25 02:06:47.304393","last_clean":"2024-04-25 02:06:47.304393","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:47.304393","last_undegraded":"2024-04-25 02:06:47.304393","last_fullsized":"2024-04-25 02:06:47.304393","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.557661","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:33.557661","last_peered":"2024-04-25 02:06:33.557661","last_clean":"2024-04-25 02:06:33.557661","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:33.557661","last_undegraded":"2024-04-25 02:06:33.557661","last_fullsized":"2024-04-25 02:06:33.557661","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.300953","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:47.300953","last_peered":"2024-04-25 02:06:47.300953","last_clean":"2024-04-25 02:06:47.300953","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:47.300953","last_undegraded":"2024-04-25 02:06:47.300953","last_fullsized":"2024-04-25 02:06:47.300953","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.302631","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:47.302631","last_peered":"2024-04-25 02:06:47.302631","last_clean":"2024-04-25 02:06:47.302631","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:47.302631","last_undegraded":"2024-04-25 02:06:47.302631","last_fullsized":"2024-04-25 02:06:47.302631","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.300538","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:47.300538","last_peered":"2024-04-25 02:06:47.300538","last_clean":"2024-04-25 02:06:47.300538","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:47.300538","last_undegraded":"2024-04-25 02:06:47.300538","last_fullsized":"2024-04-25 02:06:47.300538","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.558047","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:33.558047","last_peered":"2024-04-25 02:06:33.558047","last_clean":"2024-04-25 02:06:33.558047","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:33.558047","last_undegraded":"2024-04-25 02:06:33.558047","last_fullsized":"2024-04-25 02:06:33.558047","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.557718","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:33.557718","last_peered":"2024-04-25 02:06:33.557718","last_clean":"2024-04-25 02:06:33.557718","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:33.557718","last_undegraded":"2024-04-25 02:06:33.557718","last_fullsized":"2024-04-25 02:06:33.557718","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.301597","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:47.301597","last_peered":"2024-04-25 02:06:47.301597","last_clean":"2024-04-25 02:06:47.301597","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:47.301597","last_undegraded":"2024-04-25 02:06:47.301597","last_fullsized":"2024-04-25 02:06:47.301597","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705681,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":79173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.224}]},{"osd":1,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.31},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.23400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":78427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":3.2770000000000001,"5min":3.2770000000000001,"15min":3.2770000000000001},"last":0.22800000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.4260000000000002,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":6.2469999999999999,"5min":6.2469999999999999,"15min":6.2469999999999999},"last":0.251}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.26400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":73636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.317}]},{"osd":2,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.218}]},{"osd":3,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.23400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":74202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.246}]},{"osd":2,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.316}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.32500000000000001}]}]}]}} 2024-04-25T02:06:52.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.832 7f7681cea700 1 Processor -- start 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.832 7f7681cea700 1 -- start start 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f7681cea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0f5920 0x7f767c0f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f7681cea700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f767c0f1ec0 0x7f767c10e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f7681cea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0f2310 0x7f767c10e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f7681cea700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c0f9230 con 0x7f767c0f1ec0 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f7681cea700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c10ef10 con 0x7f767c0f5920 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f7681cea700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1aa660 con 0x7f767c0f2310 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f767a2b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f767c0f1ec0 0x7f767c10e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f767b2b3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0f2310 0x7f767c10e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f767a2b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f767c0f1ec0 0x7f767c10e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47320/0 (socket says 172.21.15.57:47320) 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f767aab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0f5920 0x7f767c0f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f767b2b3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0f2310 0x7f767c10e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45134/0 (socket says 172.21.15.57:45134) 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f767a2b1700 1 -- 172.21.15.57:0/3075301497 learned_addr learned my addr 172.21.15.57:0/3075301497 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f767a2b1700 1 -- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0f2310 msgr2=0x7f767c10e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.833 7f767a2b1700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0f2310 0x7f767c10e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f767a2b1700 1 -- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0f5920 msgr2=0x7f767c0f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f767a2b1700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0f5920 0x7f767c0f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f767a2b1700 1 -- 172.21.15.57:0/3075301497 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c1aa810 con 0x7f767c0f1ec0 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f767b2b3700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0f2310 0x7f767c10e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f767aab2700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0f5920 0x7f767c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f767a2b1700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c0f1ec0 0x7f767c10e2b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f767c1037f0 tx=0x7f766c009a80).ready entity=mon.0 client_cookie=88d6bcf2f0c54f26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7679ab0700 1 -- 172.21.15.57:0/3075301497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f767c1aa810 con 0x7f767c0f1ec0 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7679ab0700 1 -- 172.21.15.57:0/3075301497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c00f510 con 0x7f767c0f1ec0 2024-04-25T02:06:52.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7679ab0700 1 -- 172.21.15.57:0/3075301497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f766c00f6f0 con 0x7f767c0f1ec0 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7681cea700 1 -- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c0f1ec0 msgr2=0x7f767c10e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7681cea700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c0f1ec0 0x7f767c10e2b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f767c1037f0 tx=0x7f766c009a80).stop 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7681cea700 1 -- 172.21.15.57:0/3075301497 shutdown_connections 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7681cea700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0f2310 0x7f767c10e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7681cea700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0f5920 0x7f767c0f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7681cea700 1 --2- 172.21.15.57:0/3075301497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c0f1ec0 0x7f767c10e2b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7681cea700 1 -- 172.21.15.57:0/3075301497 >> 172.21.15.57:0/3075301497 conn(0x7f767c113a70 msgr2=0x7f767c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.834 7f7681cea700 1 -- 172.21.15.57:0/3075301497 shutdown_connections 2024-04-25T02:06:52.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.835 7f7681cea700 1 -- 172.21.15.57:0/3075301497 wait complete. 2024-04-25T02:06:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.858 7f7681cea700 1 Processor -- start 2024-04-25T02:06:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.858 7f7681cea700 1 -- start start 2024-04-25T02:06:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f7681cea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0cc460 0x7f767c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f7681cea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0ccee0 0x7f767c1b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f7681cea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c1b4bc0 0x7f767c1b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:52.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f7681cea700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0be750 con 0x7f767c1b4bc0 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f7681cea700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1b5640 con 0x7f767c0cc460 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f7681cea700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0da1e0 con 0x7f767c0ccee0 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767b2b3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c1b4bc0 0x7f767c1b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767aab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0cc460 0x7f767c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767a2b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0ccee0 0x7f767c1b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767b2b3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c1b4bc0 0x7f767c1b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47324/0 (socket says 172.21.15.57:47324) 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767b2b3700 1 -- 172.21.15.57:0/950713424 learned_addr learned my addr 172.21.15.57:0/950713424 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767aab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0cc460 0x7f767c0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40586/0 (socket says 172.21.15.57:40586) 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767aab2700 1 -- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0ccee0 msgr2=0x7f767c1b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767aab2700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0ccee0 0x7f767c1b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767aab2700 1 -- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c1b4bc0 msgr2=0x7f767c1b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767aab2700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c1b4bc0 0x7f767c1b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767aab2700 1 -- 172.21.15.57:0/950713424 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0da710 con 0x7f767c0cc460 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767b2b3700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c1b4bc0 0x7f767c1b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767a2b1700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0ccee0 0x7f767c1b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.859 7f767aab2700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0cc460 0x7f767c0cc8b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f767c0cf930 tx=0x7f766400ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.860 7f7673fff700 1 -- 172.21.15.57:0/950713424 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f767c0da710 con 0x7f767c0cc460 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.860 7f7673fff700 1 -- 172.21.15.57:0/950713424 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400c790 con 0x7f767c0cc460 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.860 7f7681cea700 1 -- 172.21.15.57:0/950713424 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c0e0d60 con 0x7f767c0cc460 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.860 7f7673fff700 1 -- 172.21.15.57:0/950713424 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f766400f040 con 0x7f767c0cc460 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.860 7f7681cea700 1 -- 172.21.15.57:0/950713424 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c1bbf70 con 0x7f767c0cc460 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.860 7f7673fff700 1 -- 172.21.15.57:0/950713424 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f7664011070 con 0x7f767c0cc460 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.860 7f7673fff700 1 -- 172.21.15.57:0/950713424 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f7664010040 con 0x7f767c0cc460 2024-04-25T02:06:52.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.861 7f7681cea700 1 -- 172.21.15.57:0/950713424 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c0f08e0 con 0x7f767c0cc460 2024-04-25T02:06:52.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.864 7f7673fff700 1 -- 172.21.15.57:0/950713424 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f766400ee10 con 0x7f767c0cc460 2024-04-25T02:06:52.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.976 7f7681cea700 1 -- 172.21.15.57:0/950713424 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f767c1aec90 con 0x7f767c0cc460 2024-04-25T02:06:52.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.977 7f7673fff700 1 -- 172.21.15.57:0/950713424 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+5932 (secure 0 0 0) 0x7f7664000c30 con 0x7f767c0cc460 2024-04-25T02:06:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:52.983 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"f8b8656c-c3d2-4264-b256-59947e4191e7","created":"2024-04-25 02:05:27.625638","modified":"2024-04-25 02:06:50.463880","last_up_change":"2024-04-25 02:05:33.696326","last_in_change":"2024-04-25 02:05:33.696326","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25 02:05:37.065200","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ddbfde7d-6964-42f8-931b-4c4181565274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":43631}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":43631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":43631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":43631}]},"public_addr":"172.21.15.57:6812/43631","cluster_addr":"172.21.15.57:6813/43631","heartbeat_back_addr":"172.21.15.57:6815/43631","heartbeat_front_addr":"172.21.15.57:6814/43631","state":["exists","up"]},{"osd":1,"uuid":"76399db5-6fb7-4f04-9c9f-b35ff68a8d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":43629}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":43629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":43629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":43629}]},"public_addr":"172.21.15.57:6804/43629","cluster_addr":"172.21.15.57:6805/43629","heartbeat_back_addr":"172.21.15.57:6807/43629","heartbeat_front_addr":"172.21.15.57:6806/43629","state":["exists","up"]},{"osd":2,"uuid":"f0f51faf-c079-4f62-80db-dbec64d28887","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":43633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":43633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":43633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":43633}]},"public_addr":"172.21.15.57:6800/43633","cluster_addr":"172.21.15.57:6801/43633","heartbeat_back_addr":"172.21.15.57:6803/43633","heartbeat_front_addr":"172.21.15.57:6802/43633","state":["exists","up"]},{"osd":3,"uuid":"56f7d9c7-7455-4936-91f1-96bbc0ff7d78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":43632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":43632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":43632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":43632}]},"public_addr":"172.21.15.57:6808/43632","cluster_addr":"172.21.15.57:6809/43632","heartbeat_back_addr":"172.21.15.57:6811/43632","heartbeat_front_addr":"172.21.15.57:6810/43632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.57:6817/32905363":"2024-04-26 02:06:47.289265"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.978 7f7681cea700 1 -- 172.21.15.57:0/950713424 >> v1:172.21.15.57:6816/43033 conn(0x7f76600145b0 legacy=0x7f7660016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.978 7f7681cea700 1 -- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0cc460 msgr2=0x7f767c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.978 7f7681cea700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0cc460 0x7f767c0cc8b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f767c0cf930 tx=0x7f766400ecd0).stop 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.979 7f7681cea700 1 -- 172.21.15.57:0/950713424 shutdown_connections 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.979 7f7681cea700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f767c1b4bc0 0x7f767c1b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.979 7f7681cea700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f767c0cc460 0x7f767c0cc8b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.979 7f7681cea700 1 --2- 172.21.15.57:0/950713424 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f767c0ccee0 0x7f767c1b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.979 7f7681cea700 1 -- 172.21.15.57:0/950713424 >> 172.21.15.57:0/950713424 conn(0x7f767c0de910 msgr2=0x7f767c0d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.979 7f7681cea700 1 -- 172.21.15.57:0/950713424 shutdown_connections 2024-04-25T02:06:52.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:52.979 7f7681cea700 1 -- 172.21.15.57:0/950713424 wait complete. 2024-04-25T02:06:53.996 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T02:06:53.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:06:54.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.140 7fe3d5cdc700 1 Processor -- start 2024-04-25T02:06:54.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.140 7fe3d5cdc700 1 -- start start 2024-04-25T02:06:54.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3d5cdc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3d00f5910 0x7fe3d010c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3d5cdc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d010c960 0x7fe3d00f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3d5cdc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d010cdb0 0x7fe3d00f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3d5cdc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00fa280 con 0x7fe3d00f5910 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3d5cdc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00f95b0 con 0x7fe3d010c960 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3d5cdc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00f24e0 con 0x7fe3d010cdb0 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3d00f5910 0x7fe3d010c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3c62b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d010c960 0x7fe3d00f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3d00f5910 0x7fe3d010c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47340/0 (socket says 172.21.15.57:47340) 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 -- 172.21.15.57:0/1461294856 learned_addr learned my addr 172.21.15.57:0/1461294856 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3c62b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d010c960 0x7fe3d00f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40602/0 (socket says 172.21.15.57:40602) 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3cf2b3700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d010cdb0 0x7fe3d00f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 -- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d010cdb0 msgr2=0x7fe3d00f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d010cdb0 0x7fe3d00f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 -- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d010c960 msgr2=0x7fe3d00f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d010c960 0x7fe3d00f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 -- 172.21.15.57:0/1461294856 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00f2710 con 0x7fe3d00f5910 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3c62b1700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d010c960 0x7fe3d00f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.141 7fe3ceab2700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00f5910 0x7fe3d010c330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe3d01133f0 tx=0x7fe3c0009a80).ready entity=mon.0 client_cookie=833d6862dc2ce622 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3ce2b1700 1 -- 172.21.15.57:0/1461294856 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3d00f2710 con 0x7fe3d00f5910 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3ce2b1700 1 -- 172.21.15.57:0/1461294856 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000f510 con 0x7fe3d00f5910 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3ce2b1700 1 -- 172.21.15.57:0/1461294856 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3c000f6f0 con 0x7fe3d00f5910 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 -- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00f5910 msgr2=0x7fe3d010c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00f5910 0x7fe3d010c330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe3d01133f0 tx=0x7fe3c0009a80).stop 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 -- 172.21.15.57:0/1461294856 shutdown_connections 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d010cdb0 0x7fe3d00f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00f5910 0x7fe3d010c330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 --2- 172.21.15.57:0/1461294856 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d010c960 0x7fe3d00f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 -- 172.21.15.57:0/1461294856 >> 172.21.15.57:0/1461294856 conn(0x7fe3d0113a60 msgr2=0x7fe3d00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 -- 172.21.15.57:0/1461294856 shutdown_connections 2024-04-25T02:06:54.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.142 7fe3d5cdc700 1 -- 172.21.15.57:0/1461294856 wait complete. 2024-04-25T02:06:54.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.166 7fe3d5cdc700 1 Processor -- start 2024-04-25T02:06:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.166 7fe3d5cdc700 1 -- start start 2024-04-25T02:06:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3d5cdc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d01a3f50 0x7fe3d00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3d5cdc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d00d4760 0x7fe3d01aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3d5cdc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00d4bb0 0x7fe3d01b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3d5cdc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0113a60 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3d5cdc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01a49a0 con 0x7fe3d00d4760 2024-04-25T02:06:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3d5cdc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01a4580 con 0x7fe3d01a3f50 2024-04-25T02:06:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00d4bb0 0x7fe3d01b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3c62b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d00d4760 0x7fe3d01aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00d4bb0 0x7fe3d01b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47354/0 (socket says 172.21.15.57:47354) 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3c62b1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d00d4760 0x7fe3d01aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40604/0 (socket says 172.21.15.57:40604) 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 -- 172.21.15.57:0/2530092532 learned_addr learned my addr 172.21.15.57:0/2530092532 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3ceab2700 1 --2- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d01a3f50 0x7fe3d00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 -- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d01a3f50 msgr2=0x7fe3d00d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 --2- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d01a3f50 0x7fe3d00d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 -- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d00d4760 msgr2=0x7fe3d01aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 --2- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d00d4760 0x7fe3d01aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 -- 172.21.15.57:0/2530092532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d01b0bf0 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3ceab2700 1 --2- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3d01a3f50 0x7fe3d00d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3c62b1700 1 --2- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3d00d4760 0x7fe3d01aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.167 7fe3cf2b3700 1 --2- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00d4bb0 0x7fe3d01b05c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe3d00c2e70 tx=0x7fe3c800f6e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.168 7fe3ccaae700 1 -- 172.21.15.57:0/2530092532 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3d01b0bf0 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.168 7fe3ccaae700 1 -- 172.21.15.57:0/2530092532 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c801a660 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.168 7fe3ccaae700 1 -- 172.21.15.57:0/2530092532 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe3c8016070 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.168 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d01b0f10 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.168 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d01b78e0 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.169 7fe3ccaae700 1 -- 172.21.15.57:0/2530092532 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe3c801aa30 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.169 7fe3ccaae700 1 -- 172.21.15.57:0/2530092532 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fe3c801ca60 con 0x7fe3d00d4bb0 2024-04-25T02:06:54.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.169 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 --> v1:172.21.15.57:6812/43631 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3d01a4cf0 con 0x7fe3d00e5a20 2024-04-25T02:06:54.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.170 7fe3ccaae700 1 -- 172.21.15.57:0/2530092532 <== osd.0 v1:172.21.15.57:6812/43631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fe3b800bae0 con 0x7fe3d00e5a20 2024-04-25T02:06:54.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 --> v1:172.21.15.57:6812/43631 -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7fe3d0087810 con 0x7fe3d00e5a20 2024-04-25T02:06:54.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3ccaae700 1 -- 172.21.15.57:0/2530092532 <== osd.0 v1:172.21.15.57:6812/43631 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (unknown 1994953735 0 0) 0x7fe3b800bcc0 con 0x7fe3d00e5a20 2024-04-25T02:06:54.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 >> v1:172.21.15.57:6812/43631 conn(0x7fe3d00e5a20 legacy=0x7fe3d00a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 >> v1:172.21.15.57:6816/43033 conn(0x7fe3b40145b0 legacy=0x7fe3b4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00d4bb0 msgr2=0x7fe3d01b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 --2- 172.21.15.57:0/2530092532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3d00d4bb0 0x7fe3d01b05c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe3d00c2e70 tx=0x7fe3c800f6e0).stop 2024-04-25T02:06:54.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3cf2b3700 1 -- 172.21.15.57:0/2530092532 reap_dead start 2024-04-25T02:06:54.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 shutdown_connections 2024-04-25T02:06:54.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 >> 172.21.15.57:0/2530092532 conn(0x7fe3d00c37d0 msgr2=0x7fe3d00de8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 shutdown_connections 2024-04-25T02:06:54.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.176 7fe3d5cdc700 1 -- 172.21.15.57:0/2530092532 wait complete. 2024-04-25T02:06:54.184 INFO:teuthology.orchestra.run.smithi057.stderr:Set osd_debug_deep_scrub_sleep to 0 2024-04-25T02:06:54.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T02:06:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.319 7fbdf4e6b700 1 Processor -- start 2024-04-25T02:06:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.319 7fbdf4e6b700 1 -- start start 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdf4e6b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbdf00f5890 0x7fbdf010c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdf4e6b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf010cd30 0x7fbdf00f2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdf4e6b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00f2630 con 0x7fbdf010c8e0 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdf4e6b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00fa200 con 0x7fbdf00f5890 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdf4e6b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00f9530 con 0x7fbdf010cd30 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdedb64700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbdf00f5890 0x7fbdf010c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdee365700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf010cd30 0x7fbdf00f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbde5363700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbdf010c8e0 0x7fbdf00f1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37880/0 (socket says 172.21.15.57:37880) 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbde5363700 1 -- 172.21.15.57:0/2820191536 learned_addr learned my addr 172.21.15.57:0/2820191536 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdedb64700 1 -- 172.21.15.57:0/2820191536 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf010cd30 msgr2=0x7fbdf00f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdedb64700 1 --2- 172.21.15.57:0/2820191536 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf010cd30 0x7fbdf00f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbdedb64700 1 -- 172.21.15.57:0/2820191536 >> v1:172.21.15.57:6789/0 conn(0x7fbdf010c8e0 legacy=0x7fbdf00f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdedb64700 1 -- 172.21.15.57:0/2820191536 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf01aa550 con 0x7fbdf00f5890 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.320 7fbded363700 1 -- 172.21.15.57:0/2820191536 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529057370 0 0) 0x7fbdd8001110 con 0x7fbdf010c8e0 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdedb64700 1 --2- 172.21.15.57:0/2820191536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00f5890 0x7fbdf010c2b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fbdf0113370 tx=0x7fbde000ba20).ready entity=mon.0 client_cookie=c36fe782c1d40c2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbded363700 1 -- 172.21.15.57:0/2820191536 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbdf01aa550 con 0x7fbdf00f5890 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbded363700 1 -- 172.21.15.57:0/2820191536 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde000d5c0 con 0x7fbdf00f5890 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbded363700 1 -- 172.21.15.57:0/2820191536 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbde000d990 con 0x7fbdf00f5890 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdf4e6b700 1 -- 172.21.15.57:0/2820191536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00f5890 msgr2=0x7fbdf010c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdf4e6b700 1 --2- 172.21.15.57:0/2820191536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00f5890 0x7fbdf010c2b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fbdf0113370 tx=0x7fbde000ba20).stop 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdf4e6b700 1 -- 172.21.15.57:0/2820191536 shutdown_connections 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdf4e6b700 1 --2- 172.21.15.57:0/2820191536 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf010cd30 0x7fbdf00f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdf4e6b700 1 --2- 172.21.15.57:0/2820191536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00f5890 0x7fbdf010c2b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdf4e6b700 1 -- 172.21.15.57:0/2820191536 >> 172.21.15.57:0/2820191536 conn(0x7fbdf01139e0 msgr2=0x7fbdf00f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.321 7fbdf4e6b700 1 -- 172.21.15.57:0/2820191536 shutdown_connections 2024-04-25T02:06:54.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.322 7fbdf4e6b700 1 -- 172.21.15.57:0/2820191536 wait complete. 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.345 7fbdf4e6b700 1 Processor -- start 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.345 7fbdf4e6b700 1 -- start start 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdf4e6b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf00d09b0 0x7fbdf00d8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdf4e6b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00d8b70 0x7fbdf00dd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdf4e6b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdf00d8fc0 0x7fbdf00dd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdf4e6b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00e6510 con 0x7fbdf00d8b70 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdf4e6b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00df6b0 con 0x7fbdf00d09b0 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdf4e6b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00de000 con 0x7fbdf00d8fc0 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf00d09b0 0x7fbdf00d8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf00d09b0 0x7fbdf00d8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40622/0 (socket says 172.21.15.57:40622) 2024-04-25T02:06:54.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbde5363700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00d8b70 0x7fbdf00dd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 -- 172.21.15.57:0/3650239039 learned_addr learned my addr 172.21.15.57:0/3650239039 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdee365700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdf00d8fc0 0x7fbdf00dd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 -- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdf00d8fc0 msgr2=0x7fbdf00dd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdf00d8fc0 0x7fbdf00dd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 -- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00d8b70 msgr2=0x7fbdf00dd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00d8b70 0x7fbdf00dd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 -- 172.21.15.57:0/3650239039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00de230 con 0x7fbdf00d09b0 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbde5363700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00d8b70 0x7fbdf00dd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdee365700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdf00d8fc0 0x7fbdf00dd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:54.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdedb64700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf00d09b0 0x7fbdf00d8540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fbdf01a95a0 tx=0x7fbde00068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbde77fe700 1 -- 172.21.15.57:0/3650239039 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbdf00de230 con 0x7fbdf00d09b0 2024-04-25T02:06:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbde77fe700 1 -- 172.21.15.57:0/3650239039 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde00117e0 con 0x7fbdf00d09b0 2024-04-25T02:06:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf01bbba0 con 0x7fbdf00d09b0 2024-04-25T02:06:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.346 7fbde77fe700 1 -- 172.21.15.57:0/3650239039 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbde0011bb0 con 0x7fbdf00d09b0 2024-04-25T02:06:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.347 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf01bbf80 con 0x7fbdf00d09b0 2024-04-25T02:06:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.347 7fbde77fe700 1 -- 172.21.15.57:0/3650239039 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fbde0027460 con 0x7fbdf00d09b0 2024-04-25T02:06:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.347 7fbde77fe700 1 -- 172.21.15.57:0/3650239039 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fbde0021c50 con 0x7fbdf00d09b0 2024-04-25T02:06:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.348 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf00f0850 con 0x7fbdf00d09b0 2024-04-25T02:06:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.351 7fbde77fe700 1 -- 172.21.15.57:0/3650239039 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fbde000d3b0 con 0x7fbdf00d09b0 2024-04-25T02:06:54.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.462 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mgr", ""]}) v1 -- 0x7fbdf0087740 con 0x7fbdd40145b0 2024-04-25T02:06:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.463 7fbde77fe700 1 -- 172.21.15.57:0/3650239039 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7fbdd8001580 con 0x7fbdd40145b0 2024-04-25T02:06:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 >> v1:172.21.15.57:6816/43033 conn(0x7fbdd40145b0 legacy=0x7fbdd4016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf00d09b0 msgr2=0x7fbdf00d8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf00d09b0 0x7fbdf00d8540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fbdf01a95a0 tx=0x7fbde00068c0).stop 2024-04-25T02:06:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 shutdown_connections 2024-04-25T02:06:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdf00d8fc0 0x7fbdf00dd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf00d09b0 0x7fbdf00d8540 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 --2- 172.21.15.57:0/3650239039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf00d8b70 0x7fbdf00dd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 >> 172.21.15.57:0/3650239039 conn(0x7fbdf00c5970 msgr2=0x7fbdf01a84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 shutdown_connections 2024-04-25T02:06:54.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.464 7fbdf4e6b700 1 -- 172.21.15.57:0/3650239039 wait complete. 2024-04-25T02:06:54.471 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T02:06:54.481 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T02:06:54.481 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:06:54.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.609 7f88e4270700 1 Processor -- start 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e4270700 1 -- start start 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e4270700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5910 0x7f88dc0f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e4270700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0f1eb0 0x7f88dc10e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e4270700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2300 0x7f88dc10e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e4270700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc0f9220 con 0x7f88dc0f5910 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e4270700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc10ef00 con 0x7f88dc0f2300 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e4270700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1aa650 con 0x7f88dc0f1eb0 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e106b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5910 0x7f88dc0f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e186c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2300 0x7f88dc10e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e086a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0f1eb0 0x7f88dc10e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e106b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5910 0x7f88dc0f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47378/0 (socket says 172.21.15.57:47378) 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e186c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2300 0x7f88dc10e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40638/0 (socket says 172.21.15.57:40638) 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e106b700 1 -- 172.21.15.57:0/390961709 learned_addr learned my addr 172.21.15.57:0/390961709 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.610 7f88e086a700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0f1eb0 0x7f88dc10e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45168/0 (socket says 172.21.15.57:45168) 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e106b700 1 -- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0f1eb0 msgr2=0x7f88dc10e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e106b700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0f1eb0 0x7f88dc10e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e106b700 1 -- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2300 msgr2=0x7f88dc10e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e106b700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2300 0x7f88dc10e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e106b700 1 -- 172.21.15.57:0/390961709 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc1aa800 con 0x7f88dc0f5910 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e086a700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0f1eb0 0x7f88dc10e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e106b700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0f5910 0x7f88dc0f1880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f88dc0f4630 tx=0x7f88cc009a80).ready entity=mon.0 client_cookie=3d9a163827ea1852 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88cbfff700 1 -- 172.21.15.57:0/390961709 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88dc1aa800 con 0x7f88dc0f5910 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88cbfff700 1 -- 172.21.15.57:0/390961709 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc00f510 con 0x7f88dc0f5910 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88cbfff700 1 -- 172.21.15.57:0/390961709 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88cc00f6f0 con 0x7f88dc0f5910 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e4270700 1 -- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0f5910 msgr2=0x7f88dc0f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.611 7f88e4270700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0f5910 0x7f88dc0f1880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f88dc0f4630 tx=0x7f88cc009a80).stop 2024-04-25T02:06:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.612 7f88e4270700 1 -- 172.21.15.57:0/390961709 shutdown_connections 2024-04-25T02:06:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.612 7f88e4270700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2300 0x7f88dc10e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.612 7f88e4270700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0f5910 0x7f88dc0f1880 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.612 7f88e4270700 1 --2- 172.21.15.57:0/390961709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0f1eb0 0x7f88dc10e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.612 7f88e4270700 1 -- 172.21.15.57:0/390961709 >> 172.21.15.57:0/390961709 conn(0x7f88dc113a60 msgr2=0x7f88dc0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.612 7f88e4270700 1 -- 172.21.15.57:0/390961709 shutdown_connections 2024-04-25T02:06:54.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.612 7f88e4270700 1 -- 172.21.15.57:0/390961709 wait complete. 2024-04-25T02:06:54.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.635 7f88e4270700 1 Processor -- start 2024-04-25T02:06:54.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.635 7f88e4270700 1 -- start start 2024-04-25T02:06:54.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e4270700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0cf400 0x7f88dc0cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e4270700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0cfe80 0x7f88dc1b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e4270700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc1b49a0 0x7f88dc1b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e4270700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0e5cf0 con 0x7f88dc0cfe80 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e4270700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c4d00 con 0x7f88dc0cf400 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e4270700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0be420 con 0x7f88dc1b49a0 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e086a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0cfe80 0x7f88dc1b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e186c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc1b49a0 0x7f88dc1b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e186c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc1b49a0 0x7f88dc1b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45182/0 (socket says 172.21.15.57:45182) 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e086a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0cfe80 0x7f88dc1b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47390/0 (socket says 172.21.15.57:47390) 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e186c700 1 -- 172.21.15.57:0/1778223525 learned_addr learned my addr 172.21.15.57:0/1778223525 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e106b700 1 --2- 172.21.15.57:0/1778223525 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0cf400 0x7f88dc0cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e086a700 1 -- 172.21.15.57:0/1778223525 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc1b49a0 msgr2=0x7f88dc1b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e086a700 1 --2- 172.21.15.57:0/1778223525 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc1b49a0 0x7f88dc1b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e086a700 1 -- 172.21.15.57:0/1778223525 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0cf400 msgr2=0x7f88dc0cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e086a700 1 --2- 172.21.15.57:0/1778223525 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0cf400 0x7f88dc0cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e086a700 1 -- 172.21.15.57:0/1778223525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0d5ee0 con 0x7f88dc0cfe80 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.636 7f88e086a700 1 --2- 172.21.15.57:0/1778223525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0cfe80 0x7f88dc1b4370 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f88dc0d6350 tx=0x7f88d800ebf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.637 7f88ca7fc700 1 -- 172.21.15.57:0/1778223525 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88dc0d5ee0 con 0x7f88dc0cfe80 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.637 7f88ca7fc700 1 -- 172.21.15.57:0/1778223525 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800ee60 con 0x7f88dc0cfe80 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.637 7f88e4270700 1 -- 172.21.15.57:0/1778223525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc0e0890 con 0x7f88dc0cfe80 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.637 7f88ca7fc700 1 -- 172.21.15.57:0/1778223525 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88d800f040 con 0x7f88dc0cfe80 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.637 7f88e4270700 1 -- 172.21.15.57:0/1778223525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc1bbc40 con 0x7f88dc0cfe80 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.637 7f88ca7fc700 1 -- 172.21.15.57:0/1778223525 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f88d8011070 con 0x7f88dc0cfe80 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.637 7f88ca7fc700 1 -- 172.21.15.57:0/1778223525 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f88d8010040 con 0x7f88dc0cfe80 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.638 7f88e4270700 1 -- 172.21.15.57:0/1778223525 --> v1:172.21.15.57:6804/43629 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88dc087810 con 0x7f88dc0c0320 2024-04-25T02:06:54.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.638 7f88ca7fc700 1 -- 172.21.15.57:0/1778223525 <== osd.1 v1:172.21.15.57:6804/43629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f88d4009990 con 0x7f88dc0c0320 2024-04-25T02:06:54.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.644 7f88e4270700 1 -- 172.21.15.57:0/1778223525 --> v1:172.21.15.57:6804/43629 -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f88dc0f08d0 con 0x7f88dc0c0320 2024-04-25T02:06:54.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.644 7f88ca7fc700 1 -- 172.21.15.57:0/1778223525 <== osd.1 v1:172.21.15.57:6804/43629 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (unknown 1994953735 0 0) 0x7f88dc0f08d0 con 0x7f88dc0c0320 2024-04-25T02:06:54.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e4270700 1 -- 172.21.15.57:0/1778223525 >> v1:172.21.15.57:6804/43629 conn(0x7f88dc0c0320 legacy=0x7f88dc0a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e4270700 1 -- 172.21.15.57:0/1778223525 >> v1:172.21.15.57:6816/43033 conn(0x7f88bc0145b0 legacy=0x7f88bc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e4270700 1 -- 172.21.15.57:0/1778223525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0cfe80 msgr2=0x7f88dc1b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e4270700 1 --2- 172.21.15.57:0/1778223525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0cfe80 0x7f88dc1b4370 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f88dc0d6350 tx=0x7f88d800ebf0).stop 2024-04-25T02:06:54.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e186c700 1 -- 172.21.15.57:0/1778223525 reap_dead start 2024-04-25T02:06:54.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e4270700 1 -- 172.21.15.57:0/1778223525 shutdown_connections 2024-04-25T02:06:54.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e4270700 1 -- 172.21.15.57:0/1778223525 >> 172.21.15.57:0/1778223525 conn(0x7f88dc0c5c60 msgr2=0x7f88dc0bfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e4270700 1 -- 172.21.15.57:0/1778223525 shutdown_connections 2024-04-25T02:06:54.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.645 7f88e4270700 1 -- 172.21.15.57:0/1778223525 wait complete. 2024-04-25T02:06:54.652 INFO:teuthology.orchestra.run.smithi057.stderr:Set osd_debug_deep_scrub_sleep to 0 2024-04-25T02:06:54.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T02:06:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.788 7f53c0fb9700 1 Processor -- start 2024-04-25T02:06:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.788 7f53c0fb9700 1 -- start start 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53c0fb9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0f5910 0x7f53bc0f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53c0fb9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53bc0f1eb0 0x7f53bc10e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53c0fb9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0f2300 0x7f53bc10e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53c0fb9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53bc0f9220 con 0x7f53bc0f1eb0 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53c0fb9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc10ef00 con 0x7f53bc0f5910 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53c0fb9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc1aa650 con 0x7f53bc0f2300 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b959e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53bc0f1eb0 0x7f53bc10e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b9d9f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0f5910 0x7f53bc0f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b959e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53bc0f1eb0 0x7f53bc10e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47406/0 (socket says 172.21.15.57:47406) 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b9d9f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0f5910 0x7f53bc0f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40644/0 (socket says 172.21.15.57:40644) 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b959e700 1 -- 172.21.15.57:0/2245945763 learned_addr learned my addr 172.21.15.57:0/2245945763 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53ba5a0700 1 --2- 172.21.15.57:0/2245945763 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0f2300 0x7f53bc10e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b9d9f700 1 -- 172.21.15.57:0/2245945763 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0f2300 msgr2=0x7f53bc10e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b9d9f700 1 --2- 172.21.15.57:0/2245945763 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0f2300 0x7f53bc10e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b9d9f700 1 -- 172.21.15.57:0/2245945763 >> v2:172.21.15.57:3300/0 conn(0x7f53bc0f1eb0 msgr2=0x7f53bc10e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b9d9f700 1 --2- 172.21.15.57:0/2245945763 >> v2:172.21.15.57:3300/0 conn(0x7f53bc0f1eb0 0x7f53bc10e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b9d9f700 1 -- 172.21.15.57:0/2245945763 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc1aa800 con 0x7f53bc0f5910 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b959e700 1 --2- 172.21.15.57:0/2245945763 >> v2:172.21.15.57:3300/0 conn(0x7f53bc0f1eb0 0x7f53bc10e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b9d9f700 1 --2- 172.21.15.57:0/2245945763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0f5910 0x7f53bc0f1880 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f53bc1037e0 tx=0x7f53ac00ba20).ready entity=mon.1 client_cookie=126997dbdb3bce22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.789 7f53b8d9d700 1 -- 172.21.15.57:0/2245945763 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53bc1aa800 con 0x7f53bc0f5910 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53b8d9d700 1 -- 172.21.15.57:0/2245945763 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00d570 con 0x7f53bc0f5910 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53b8d9d700 1 -- 172.21.15.57:0/2245945763 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53ac00d940 con 0x7f53bc0f5910 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 -- 172.21.15.57:0/2245945763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0f5910 msgr2=0x7f53bc0f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 --2- 172.21.15.57:0/2245945763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0f5910 0x7f53bc0f1880 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f53bc1037e0 tx=0x7f53ac00ba20).stop 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 -- 172.21.15.57:0/2245945763 shutdown_connections 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 --2- 172.21.15.57:0/2245945763 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0f2300 0x7f53bc10e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 --2- 172.21.15.57:0/2245945763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0f5910 0x7f53bc0f1880 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 --2- 172.21.15.57:0/2245945763 >> v2:172.21.15.57:3300/0 conn(0x7f53bc0f1eb0 0x7f53bc10e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 -- 172.21.15.57:0/2245945763 >> 172.21.15.57:0/2245945763 conn(0x7f53bc113a60 msgr2=0x7f53bc0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 -- 172.21.15.57:0/2245945763 shutdown_connections 2024-04-25T02:06:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.790 7f53c0fb9700 1 -- 172.21.15.57:0/2245945763 wait complete. 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.814 7f53c0fb9700 1 Processor -- start 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.814 7f53c0fb9700 1 -- start start 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.814 7f53c0fb9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0cc3d0 0x7f53bc0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.814 7f53c0fb9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0cce50 0x7f53bc1b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.814 7f53c0fb9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53bc1b4ce0 0x7f53bc1b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.814 7f53c0fb9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc0effd0 con 0x7f53bc1b4ce0 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.814 7f53c0fb9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc0be7c0 con 0x7f53bc0cc3d0 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.814 7f53c0fb9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc1b5760 con 0x7f53bc0cce50 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0cce50 0x7f53bc1b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53ba5a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53bc1b4ce0 0x7f53bc1b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b9d9f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0cc3d0 0x7f53bc0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0cce50 0x7f53bc1b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45204/0 (socket says 172.21.15.57:45204) 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53ba5a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53bc1b4ce0 0x7f53bc1b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47418/0 (socket says 172.21.15.57:47418) 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 -- 172.21.15.57:0/2803991367 learned_addr learned my addr 172.21.15.57:0/2803991367 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 -- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0cc3d0 msgr2=0x7f53bc0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 --2- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0cc3d0 0x7f53bc0cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 -- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53bc1b4ce0 msgr2=0x7f53bc1b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 --2- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53bc1b4ce0 0x7f53bc1b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 -- 172.21.15.57:0/2803991367 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc0d9990 con 0x7f53bc0cce50 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53ba5a0700 1 --2- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53bc1b4ce0 0x7f53bc1b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53b959e700 1 --2- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0cce50 0x7f53bc1b46b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f53bc0d0940 tx=0x7f53b000ec00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53aaffd700 1 -- 172.21.15.57:0/2803991367 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53bc0d9990 con 0x7f53bc0cce50 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53aaffd700 1 -- 172.21.15.57:0/2803991367 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b000c620 con 0x7f53bc0cce50 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53bc0d9ce0 con 0x7f53bc0cce50 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53aaffd700 1 -- 172.21.15.57:0/2803991367 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53b000f040 con 0x7f53bc0cce50 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.815 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53bc1bbda0 con 0x7f53bc0cce50 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.816 7f53aaffd700 1 -- 172.21.15.57:0/2803991367 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f53b0011070 con 0x7f53bc0cce50 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.816 7f53aaffd700 1 -- 172.21.15.57:0/2803991367 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f53b0010040 con 0x7f53bc0cce50 2024-04-25T02:06:54.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.816 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53bc0f08d0 con 0x7f53bc0cce50 2024-04-25T02:06:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.820 7f53aaffd700 1 -- 172.21.15.57:0/2803991367 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f53b000ee10 con 0x7f53bc0cce50 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.929 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mgr", ""]}) v1 -- 0x7f53bc0cd2a0 con 0x7f53980145b0 2024-04-25T02:06:54.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.929 7f53aaffd700 1 -- 172.21.15.57:0/2803991367 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f53bc0cd2a0 con 0x7f53980145b0 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.930 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 >> v1:172.21.15.57:6816/43033 conn(0x7f53980145b0 legacy=0x7f5398016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.930 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0cce50 msgr2=0x7f53bc1b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.930 7f53c0fb9700 1 --2- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0cce50 0x7f53bc1b46b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f53bc0d0940 tx=0x7f53b000ec00).stop 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.930 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 shutdown_connections 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.930 7f53c0fb9700 1 --2- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53bc1b4ce0 0x7f53bc1b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.930 7f53c0fb9700 1 --2- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53bc0cc3d0 0x7f53bc0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.931 7f53c0fb9700 1 --2- 172.21.15.57:0/2803991367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f53bc0cce50 0x7f53bc1b46b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.931 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 >> 172.21.15.57:0/2803991367 conn(0x7f53bc0de8f0 msgr2=0x7f53bc0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.931 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 shutdown_connections 2024-04-25T02:06:54.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:54.931 7f53c0fb9700 1 -- 172.21.15.57:0/2803991367 wait complete. 2024-04-25T02:06:54.938 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T02:06:54.947 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T02:06:54.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.076 7f88e1642700 1 Processor -- start 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.076 7f88e1642700 1 -- start start 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88e1642700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5890 0x7f88dc0f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88e1642700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2280 0x7f88dc10ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88e1642700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0f91a0 con 0x7f88dc0f1e30 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88e1642700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc10f050 con 0x7f88dc0f5890 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88e1642700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1ac5f0 con 0x7f88dc0f2280 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88daab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2280 0x7f88dc10ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88da2b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5890 0x7f88dc0f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88daab2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2280 0x7f88dc10ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40674/0 (socket says 172.21.15.57:40674) 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88daab2700 1 -- 172.21.15.57:0/1203811869 learned_addr learned my addr 172.21.15.57:0/1203811869 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88daab2700 1 -- 172.21.15.57:0/1203811869 >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5890 msgr2=0x7f88dc0f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88daab2700 1 --2- 172.21.15.57:0/1203811869 >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5890 0x7f88dc0f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88daab2700 1 -- 172.21.15.57:0/1203811869 >> v1:172.21.15.57:6789/0 conn(0x7f88dc0f1e30 legacy=0x7f88dc10e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88daab2700 1 -- 172.21.15.57:0/1203811869 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc1ac7a0 con 0x7f88dc0f2280 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88d92af700 1 -- 172.21.15.57:0/1203811869 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603853675 0 0) 0x7f88c4001110 con 0x7f88dc0f1e30 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.077 7f88da2b1700 1 --2- 172.21.15.57:0/1203811869 >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5890 0x7f88dc0f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88daab2700 1 --2- 172.21.15.57:0/1203811869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2280 0x7f88dc10ea20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f88d40032f0 tx=0x7f88d4009d60).ready entity=mon.1 client_cookie=82d29f3b185f89ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88d92af700 1 -- 172.21.15.57:0/1203811869 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88dc1ac7a0 con 0x7f88dc0f2280 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88d92af700 1 -- 172.21.15.57:0/1203811869 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d400b880 con 0x7f88dc0f2280 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88d92af700 1 -- 172.21.15.57:0/1203811869 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88d400ba60 con 0x7f88dc0f2280 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88e1642700 1 -- 172.21.15.57:0/1203811869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2280 msgr2=0x7f88dc10ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88e1642700 1 --2- 172.21.15.57:0/1203811869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2280 0x7f88dc10ea20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f88d40032f0 tx=0x7f88d4009d60).stop 2024-04-25T02:06:55.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88e1642700 1 -- 172.21.15.57:0/1203811869 shutdown_connections 2024-04-25T02:06:55.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88e1642700 1 --2- 172.21.15.57:0/1203811869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc0f2280 0x7f88dc10ea20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88e1642700 1 --2- 172.21.15.57:0/1203811869 >> v2:172.21.15.57:3300/0 conn(0x7f88dc0f5890 0x7f88dc0f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.078 7f88e1642700 1 -- 172.21.15.57:0/1203811869 >> 172.21.15.57:0/1203811869 conn(0x7f88dc1139e0 msgr2=0x7f88dc0f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.079 7f88e1642700 1 -- 172.21.15.57:0/1203811869 shutdown_connections 2024-04-25T02:06:55.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.079 7f88e1642700 1 -- 172.21.15.57:0/1203811869 wait complete. 2024-04-25T02:06:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88e1642700 1 Processor -- start 2024-04-25T02:06:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88e1642700 1 -- start start 2024-04-25T02:06:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88e1642700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0c2750 0x7f88dc0c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88e1642700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0c31d0 0x7f88dc1b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88e1642700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc1b4e50 0x7f88dc1bbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88e1642700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0eff50 con 0x7f88dc0c2750 2024-04-25T02:06:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88e1642700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0bb4f0 con 0x7f88dc1b4e50 2024-04-25T02:06:55.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88e1642700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0bb9f0 con 0x7f88dc0c31d0 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88da2b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0c2750 0x7f88dc0c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88da2b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0c2750 0x7f88dc0c2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47436/0 (socket says 172.21.15.57:47436) 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88da2b1700 1 -- 172.21.15.57:0/3397097756 learned_addr learned my addr 172.21.15.57:0/3397097756 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88d9ab0700 1 --2- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0c31d0 0x7f88dc1b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.103 7f88daab2700 1 --2- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc1b4e50 0x7f88dc1bbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88da2b1700 1 -- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0c31d0 msgr2=0x7f88dc1b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88da2b1700 1 --2- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f88dc0c31d0 0x7f88dc1b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88da2b1700 1 -- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc1b4e50 msgr2=0x7f88dc1bbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88da2b1700 1 --2- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88dc1b4e50 0x7f88dc1bbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88da2b1700 1 -- 172.21.15.57:0/3397097756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0bb730 con 0x7f88dc0c2750 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88da2b1700 1 --2- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0c2750 0x7f88dc0c2ba0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f88dc0ccb20 tx=0x7f88cc00bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88d37fe700 1 -- 172.21.15.57:0/3397097756 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88dc0bb730 con 0x7f88dc0c2750 2024-04-25T02:06:55.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88d37fe700 1 -- 172.21.15.57:0/3397097756 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc00c9a0 con 0x7f88dc0c2750 2024-04-25T02:06:55.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88e1642700 1 -- 172.21.15.57:0/3397097756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc1b52a0 con 0x7f88dc0c2750 2024-04-25T02:06:55.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88d37fe700 1 -- 172.21.15.57:0/3397097756 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88cc00f040 con 0x7f88dc0c2750 2024-04-25T02:06:55.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.104 7f88e1642700 1 -- 172.21.15.57:0/3397097756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc1bc3e0 con 0x7f88dc0c2750 2024-04-25T02:06:55.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.105 7f88d37fe700 1 -- 172.21.15.57:0/3397097756 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f88cc011070 con 0x7f88dc0c2750 2024-04-25T02:06:55.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.105 7f88d37fe700 1 -- 172.21.15.57:0/3397097756 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f88cc010040 con 0x7f88dc0c2750 2024-04-25T02:06:55.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.105 7f88e1642700 1 -- 172.21.15.57:0/3397097756 --> v1:172.21.15.57:6800/43633 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88dc087810 con 0x7f88dc0a6bf0 2024-04-25T02:06:55.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.106 7f88d37fe700 1 -- 172.21.15.57:0/3397097756 <== osd.2 v1:172.21.15.57:6800/43633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f88d4009530 con 0x7f88dc0a6bf0 2024-04-25T02:06:55.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 -- 172.21.15.57:0/3397097756 --> v1:172.21.15.57:6800/43633 -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7f88dc0f0850 con 0x7f88dc0a6bf0 2024-04-25T02:06:55.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88d37fe700 1 -- 172.21.15.57:0/3397097756 <== osd.2 v1:172.21.15.57:6800/43633 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (unknown 1994953735 0 0) 0x7f88dc0f0850 con 0x7f88dc0a6bf0 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 -- 172.21.15.57:0/3397097756 >> v1:172.21.15.57:6800/43633 conn(0x7f88dc0a6bf0 legacy=0x7f88dc0a8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 -- 172.21.15.57:0/3397097756 >> v1:172.21.15.57:6816/43033 conn(0x7f88c00145b0 legacy=0x7f88c0016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 -- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0c2750 msgr2=0x7f88dc0c2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 --2- 172.21.15.57:0/3397097756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88dc0c2750 0x7f88dc0c2ba0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f88dc0ccb20 tx=0x7f88cc00bf70).stop 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88daab2700 1 -- 172.21.15.57:0/3397097756 reap_dead start 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 -- 172.21.15.57:0/3397097756 shutdown_connections 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 -- 172.21.15.57:0/3397097756 >> 172.21.15.57:0/3397097756 conn(0x7f88dc0dc9a0 msgr2=0x7f88dc0c15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 -- 172.21.15.57:0/3397097756 shutdown_connections 2024-04-25T02:06:55.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.112 7f88e1642700 1 -- 172.21.15.57:0/3397097756 wait complete. 2024-04-25T02:06:55.120 INFO:teuthology.orchestra.run.smithi057.stderr:Set osd_debug_deep_scrub_sleep to 0 2024-04-25T02:06:55.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f681d819700 1 Processor -- start 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f681d819700 1 -- start start 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f681d819700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180f5a00 0x7f681810b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f681d819700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f681810b730 0x7f681819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f681d819700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f681810bb80 0x7f68181a0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f681d819700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68180fa580 con 0x7f681810b730 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f681d819700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68181a0890 con 0x7f681810bb80 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f681d819700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68181a0ac0 con 0x7f68180f5a00 2024-04-25T02:06:55.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f68165c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180f5a00 0x7f681810b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f6816dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f681810bb80 0x7f68181a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f6815dc4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f681810b730 0x7f681819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f6816dc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f681810bb80 0x7f68181a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40702/0 (socket says 172.21.15.57:40702) 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f68165c5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180f5a00 0x7f681810b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45226/0 (socket says 172.21.15.57:45226) 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f6815dc4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f681810b730 0x7f681819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47450/0 (socket says 172.21.15.57:47450) 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.256 7f6816dc6700 1 -- 172.21.15.57:0/2150308815 learned_addr learned my addr 172.21.15.57:0/2150308815 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68165c5700 1 -- 172.21.15.57:0/2150308815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f681810bb80 msgr2=0x7f68181a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68165c5700 1 --2- 172.21.15.57:0/2150308815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f681810bb80 0x7f68181a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68165c5700 1 -- 172.21.15.57:0/2150308815 >> v2:172.21.15.57:3300/0 conn(0x7f681810b730 msgr2=0x7f681819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68165c5700 1 --2- 172.21.15.57:0/2150308815 >> v2:172.21.15.57:3300/0 conn(0x7f681810b730 0x7f681819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68165c5700 1 -- 172.21.15.57:0/2150308815 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68181a73a0 con 0x7f68180f5a00 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68165c5700 1 --2- 172.21.15.57:0/2150308815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180f5a00 0x7f681810b100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f68180f47b0 tx=0x7f680000b9a0).ready entity=mon.2 client_cookie=feb1f08dad8c0a70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68155c3700 1 -- 172.21.15.57:0/2150308815 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68181a73a0 con 0x7f68180f5a00 2024-04-25T02:06:55.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68155c3700 1 -- 172.21.15.57:0/2150308815 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680000d570 con 0x7f68180f5a00 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f68155c3700 1 -- 172.21.15.57:0/2150308815 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f680000d940 con 0x7f68180f5a00 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f681d819700 1 -- 172.21.15.57:0/2150308815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180f5a00 msgr2=0x7f681810b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.257 7f681d819700 1 --2- 172.21.15.57:0/2150308815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180f5a00 0x7f681810b100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f68180f47b0 tx=0x7f680000b9a0).stop 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.258 7f681d819700 1 -- 172.21.15.57:0/2150308815 shutdown_connections 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.258 7f681d819700 1 --2- 172.21.15.57:0/2150308815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f681810bb80 0x7f68181a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.258 7f681d819700 1 --2- 172.21.15.57:0/2150308815 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180f5a00 0x7f681810b100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.258 7f681d819700 1 --2- 172.21.15.57:0/2150308815 >> v2:172.21.15.57:3300/0 conn(0x7f681810b730 0x7f681819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.258 7f681d819700 1 -- 172.21.15.57:0/2150308815 >> 172.21.15.57:0/2150308815 conn(0x7f6818113a60 msgr2=0x7f68180f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.258 7f681d819700 1 -- 172.21.15.57:0/2150308815 shutdown_connections 2024-04-25T02:06:55.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.258 7f681d819700 1 -- 172.21.15.57:0/2150308815 wait complete. 2024-04-25T02:06:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f681d819700 1 Processor -- start 2024-04-25T02:06:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f681d819700 1 -- start start 2024-04-25T02:06:55.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f681d819700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68181a1430 0x7f68180d4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f681d819700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68180d4e50 0x7f68181b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f681d819700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180d52a0 0x7f68181b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f681d819700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180ddf10 con 0x7f68180d4e50 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f681d819700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68180ddb80 con 0x7f68181a1430 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f681d819700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68180de1d0 con 0x7f68180d52a0 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6815dc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68180d4e50 0x7f68181b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f68165c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68181a1430 0x7f68180d4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6816dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180d52a0 0x7f68181b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6815dc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68180d4e50 0x7f68181b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47464/0 (socket says 172.21.15.57:47464) 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6816dc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180d52a0 0x7f68181b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45228/0 (socket says 172.21.15.57:45228) 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f68165c5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68181a1430 0x7f68180d4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40708/0 (socket says 172.21.15.57:40708) 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6815dc4700 1 -- 172.21.15.57:0/3624217629 learned_addr learned my addr 172.21.15.57:0/3624217629 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6815dc4700 1 -- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180d52a0 msgr2=0x7f68181b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6815dc4700 1 --2- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180d52a0 0x7f68181b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6815dc4700 1 -- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68181a1430 msgr2=0x7f68180d4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6815dc4700 1 --2- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68181a1430 0x7f68180d4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f6815dc4700 1 -- 172.21.15.57:0/3624217629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68181b4e20 con 0x7f68180d4e50 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.282 7f68165c5700 1 --2- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68181a1430 0x7f68180d4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.283 7f6815dc4700 1 --2- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68180d4e50 0x7f68181b41c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f68180c6110 tx=0x7f680800ee90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.283 7f680f7fe700 1 -- 172.21.15.57:0/3624217629 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f68181b4e20 con 0x7f68180d4e50 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.283 7f680f7fe700 1 -- 172.21.15.57:0/3624217629 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808014030 con 0x7f68180d4e50 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.283 7f681d819700 1 -- 172.21.15.57:0/3624217629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68181bb8b0 con 0x7f68180d4e50 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.283 7f680f7fe700 1 -- 172.21.15.57:0/3624217629 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6808010440 con 0x7f68180d4e50 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.283 7f681d819700 1 -- 172.21.15.57:0/3624217629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68181bbc90 con 0x7f68180d4e50 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.283 7f680f7fe700 1 -- 172.21.15.57:0/3624217629 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f6808016020 con 0x7f68180d4e50 2024-04-25T02:06:55.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.283 7f680f7fe700 1 -- 172.21.15.57:0/3624217629 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f6808007b10 con 0x7f68180d4e50 2024-04-25T02:06:55.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.284 7f681d819700 1 -- 172.21.15.57:0/3624217629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68180f08d0 con 0x7f68180d4e50 2024-04-25T02:06:55.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.287 7f680f7fe700 1 -- 172.21.15.57:0/3624217629 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f680800b920 con 0x7f68180d4e50 2024-04-25T02:06:55.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.397 7f681d819700 1 -- 172.21.15.57:0/3624217629 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mgr", ""]}) v1 -- 0x7f6818087740 con 0x7f67fc0145b0 2024-04-25T02:06:55.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.397 7f680f7fe700 1 -- 172.21.15.57:0/3624217629 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f680000b190 con 0x7f67fc0145b0 2024-04-25T02:06:55.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 -- 172.21.15.57:0/3624217629 >> v1:172.21.15.57:6816/43033 conn(0x7f67fc0145b0 legacy=0x7f67fc016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 -- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68180d4e50 msgr2=0x7f68181b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 --2- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68180d4e50 0x7f68181b41c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f68180c6110 tx=0x7f680800ee90).stop 2024-04-25T02:06:55.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 -- 172.21.15.57:0/3624217629 shutdown_connections 2024-04-25T02:06:55.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 --2- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f68180d52a0 0x7f68181b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 --2- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68181a1430 0x7f68180d4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 --2- 172.21.15.57:0/3624217629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68180d4e50 0x7f68181b41c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 -- 172.21.15.57:0/3624217629 >> 172.21.15.57:0/3624217629 conn(0x7f68180c2c70 msgr2=0x7f68180da440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 -- 172.21.15.57:0/3624217629 shutdown_connections 2024-04-25T02:06:55.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.399 7f681d819700 1 -- 172.21.15.57:0/3624217629 wait complete. 2024-04-25T02:06:55.408 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T02:06:55.416 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T02:06:55.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:06:55.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.546 7ff69d5ba700 1 Processor -- start 2024-04-25T02:06:55.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.546 7ff69d5ba700 1 -- start start 2024-04-25T02:06:55.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.546 7ff69d5ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6980f5a00 0x7ff69810b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.546 7ff69d5ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff69810bb80 0x7ff6981a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.546 7ff69d5ba700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6981a0a60 con 0x7ff69810b730 2024-04-25T02:06:55.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.546 7ff69d5ba700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6980fa580 con 0x7ff6980f5a00 2024-04-25T02:06:55.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.546 7ff69d5ba700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6981a0c80 con 0x7ff69810bb80 2024-04-25T02:06:55.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff6962b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6980f5a00 0x7ff69810b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff68ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff69810b730 0x7ff69819fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37892/0 (socket says 172.21.15.57:37892) 2024-04-25T02:06:55.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff6962b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6980f5a00 0x7ff69810b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47480/0 (socket says 172.21.15.57:47480) 2024-04-25T02:06:55.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff68ffff700 1 -- 172.21.15.57:0/1908374355 learned_addr learned my addr 172.21.15.57:0/1908374355 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff696ab2700 1 --2- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff69810bb80 0x7ff6981a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff6962b1700 1 -- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff69810bb80 msgr2=0x7ff6981a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff6962b1700 1 --2- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff69810bb80 0x7ff6981a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff6962b1700 1 -- 172.21.15.57:0/1908374355 >> v1:172.21.15.57:6789/0 conn(0x7ff69810b730 legacy=0x7ff69819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff695ab0700 1 -- 172.21.15.57:0/1908374355 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069775939 0 0) 0x7ff680001110 con 0x7ff69810b730 2024-04-25T02:06:55.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff6962b1700 1 -- 172.21.15.57:0/1908374355 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6981a93c0 con 0x7ff6980f5a00 2024-04-25T02:06:55.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff696ab2700 1 --2- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff69810bb80 0x7ff6981a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:55.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff6962b1700 1 --2- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980f5a00 0x7ff69810b100 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7ff698103a00 tx=0x7ff68800dc80).ready entity=mon.0 client_cookie=d9e2ea799997a541 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff695ab0700 1 -- 172.21.15.57:0/1908374355 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff6981a93c0 con 0x7ff6980f5a00 2024-04-25T02:06:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff695ab0700 1 -- 172.21.15.57:0/1908374355 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68800bba0 con 0x7ff6980f5a00 2024-04-25T02:06:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff695ab0700 1 -- 172.21.15.57:0/1908374355 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff688015070 con 0x7ff6980f5a00 2024-04-25T02:06:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff69d5ba700 1 -- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980f5a00 msgr2=0x7ff69810b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.547 7ff69d5ba700 1 --2- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980f5a00 0x7ff69810b100 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7ff698103a00 tx=0x7ff68800dc80).stop 2024-04-25T02:06:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.548 7ff69d5ba700 1 -- 172.21.15.57:0/1908374355 shutdown_connections 2024-04-25T02:06:55.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.548 7ff69d5ba700 1 --2- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff69810bb80 0x7ff6981a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.548 7ff69d5ba700 1 --2- 172.21.15.57:0/1908374355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980f5a00 0x7ff69810b100 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.548 7ff69d5ba700 1 -- 172.21.15.57:0/1908374355 >> 172.21.15.57:0/1908374355 conn(0x7ff698113a60 msgr2=0x7ff6980f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.548 7ff69d5ba700 1 -- 172.21.15.57:0/1908374355 shutdown_connections 2024-04-25T02:06:55.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.548 7ff69d5ba700 1 -- 172.21.15.57:0/1908374355 wait complete. 2024-04-25T02:06:55.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff69d5ba700 1 Processor -- start 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff69d5ba700 1 -- start start 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff69d5ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff6980d7180 0x7ff6980ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff69d5ba700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980cea20 0x7ff6981b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff69d5ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980cee70 0x7ff6981b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff69d5ba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980dd640 con 0x7ff6980cee70 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff69d5ba700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980d75d0 con 0x7ff6980cea20 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff69d5ba700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6981b0e10 con 0x7ff6980d7180 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff6962b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff6980d7180 0x7ff6980ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff696ab2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980cee70 0x7ff6981b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff696ab2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980cee70 0x7ff6981b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47488/0 (socket says 172.21.15.57:47488) 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff6962b1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff6980d7180 0x7ff6980ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45258/0 (socket says 172.21.15.57:45258) 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff696ab2700 1 -- 172.21.15.57:0/4010002828 learned_addr learned my addr 172.21.15.57:0/4010002828 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.572 7ff68ffff700 1 --2- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980cea20 0x7ff6981b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff6962b1700 1 -- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980cea20 msgr2=0x7ff6981b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff6962b1700 1 --2- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980cea20 0x7ff6981b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff6962b1700 1 -- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980cee70 msgr2=0x7ff6981b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff6962b1700 1 --2- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980cee70 0x7ff6981b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff6962b1700 1 -- 172.21.15.57:0/4010002828 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6981b1040 con 0x7ff6980d7180 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff696ab2700 1 --2- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6980cee70 0x7ff6981b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff6962b1700 1 --2- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff6980d7180 0x7ff6980ce3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7ff698103a00 tx=0x7ff6880068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff68f7fe700 1 -- 172.21.15.57:0/4010002828 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff6981b1040 con 0x7ff6980d7180 2024-04-25T02:06:55.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff68f7fe700 1 -- 172.21.15.57:0/4010002828 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68801a480 con 0x7ff6980d7180 2024-04-25T02:06:55.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff68f7fe700 1 -- 172.21.15.57:0/4010002828 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff688021070 con 0x7ff6980d7180 2024-04-25T02:06:55.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6981b78a0 con 0x7ff6980d7180 2024-04-25T02:06:55.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6981b7c80 con 0x7ff6980d7180 2024-04-25T02:06:55.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.573 7ff68f7fe700 1 -- 172.21.15.57:0/4010002828 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7ff688025460 con 0x7ff6980d7180 2024-04-25T02:06:55.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.574 7ff68f7fe700 1 -- 172.21.15.57:0/4010002828 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7ff68801eab0 con 0x7ff6980d7180 2024-04-25T02:06:55.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.574 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 --> v1:172.21.15.57:6808/43632 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff698087810 con 0x7ff6981a4ba0 2024-04-25T02:06:55.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.575 7ff68f7fe700 1 -- 172.21.15.57:0/4010002828 <== osd.3 v1:172.21.15.57:6808/43632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7ff690009d00 con 0x7ff6981a4ba0 2024-04-25T02:06:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 --> v1:172.21.15.57:6808/43632 -- command(tid 2: {"prefix": "config set", "key": "osd_debug_deep_scrub_sleep", "value": "0"}) v1 -- 0x7ff6980f08d0 con 0x7ff6981a4ba0 2024-04-25T02:06:55.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff68f7fe700 1 -- 172.21.15.57:0/4010002828 <== osd.3 v1:172.21.15.57:6808/43632 2 ==== command_reply(tid 2: 0 Set osd_debug_deep_scrub_sleep to 0) v1 ==== 43+0+0 (unknown 1994953735 0 0) 0x7ff6980f08d0 con 0x7ff6981a4ba0 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 >> v1:172.21.15.57:6808/43632 conn(0x7ff6981a4ba0 legacy=0x7ff6980a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 >> v1:172.21.15.57:6816/43033 conn(0x7ff67c0145b0 legacy=0x7ff67c016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff6980d7180 msgr2=0x7ff6980ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 --2- 172.21.15.57:0/4010002828 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff6980d7180 0x7ff6980ce3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7ff698103a00 tx=0x7ff6880068c0).stop 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff696ab2700 1 -- 172.21.15.57:0/4010002828 reap_dead start 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 shutdown_connections 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 >> 172.21.15.57:0/4010002828 conn(0x7ff6980c5520 msgr2=0x7ff6981a43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 shutdown_connections 2024-04-25T02:06:55.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.581 7ff69d5ba700 1 -- 172.21.15.57:0/4010002828 wait complete. 2024-04-25T02:06:55.589 INFO:teuthology.orchestra.run.smithi057.stderr:Set osd_debug_deep_scrub_sleep to 0 2024-04-25T02:06:55.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.723 7f7861740700 1 Processor -- start 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.723 7f7861740700 1 -- start start 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f7861740700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0f5a00 0x7f785c10b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f7861740700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c10b730 0x7f785c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f7861740700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c1a0a60 con 0x7f785c10bb80 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f7861740700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0fa580 con 0x7f785c0f5a00 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f7861740700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f785c1a0c80 con 0x7f785c10b730 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f785a4ec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0f5a00 0x7f785c10b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f7859ceb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c10b730 0x7f785c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f785a4ec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0f5a00 0x7f785c10b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40728/0 (socket says 172.21.15.57:40728) 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f7859ceb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c10b730 0x7f785c19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45266/0 (socket says 172.21.15.57:45266) 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f785a4ec700 1 -- 172.21.15.57:0/3817090818 learned_addr learned my addr 172.21.15.57:0/3817090818 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f785a4ec700 1 -- 172.21.15.57:0/3817090818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c10b730 msgr2=0x7f785c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f78594ea700 1 -- 172.21.15.57:0/3817090818 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139313639 0 0) 0x7f7854001490 con 0x7f785c10bb80 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f785a4ec700 1 --2- 172.21.15.57:0/3817090818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c10b730 0x7f785c19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f785a4ec700 1 -- 172.21.15.57:0/3817090818 >> v1:172.21.15.57:6789/0 conn(0x7f785c10bb80 legacy=0x7f785c1a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f785a4ec700 1 -- 172.21.15.57:0/3817090818 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c1a93c0 con 0x7f785c0f5a00 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.724 7f7859ceb700 1 --2- 172.21.15.57:0/3817090818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c10b730 0x7f785c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f785a4ec700 1 --2- 172.21.15.57:0/3817090818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0f5a00 0x7f785c10b100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f785c10c210 tx=0x7f784c009ab0).ready entity=mon.1 client_cookie=1a95462d920fee92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f78594ea700 1 -- 172.21.15.57:0/3817090818 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f785c1a93c0 con 0x7f785c0f5a00 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f78594ea700 1 -- 172.21.15.57:0/3817090818 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00f510 con 0x7f785c0f5a00 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f78594ea700 1 -- 172.21.15.57:0/3817090818 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f784c00f6f0 con 0x7f785c0f5a00 2024-04-25T02:06:55.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f7861740700 1 -- 172.21.15.57:0/3817090818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0f5a00 msgr2=0x7f785c10b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f7861740700 1 --2- 172.21.15.57:0/3817090818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0f5a00 0x7f785c10b100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f785c10c210 tx=0x7f784c009ab0).stop 2024-04-25T02:06:55.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f7861740700 1 -- 172.21.15.57:0/3817090818 shutdown_connections 2024-04-25T02:06:55.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f7861740700 1 --2- 172.21.15.57:0/3817090818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0f5a00 0x7f785c10b100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f7861740700 1 --2- 172.21.15.57:0/3817090818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c10b730 0x7f785c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f7861740700 1 -- 172.21.15.57:0/3817090818 >> 172.21.15.57:0/3817090818 conn(0x7f785c113a60 msgr2=0x7f785c0f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f7861740700 1 -- 172.21.15.57:0/3817090818 shutdown_connections 2024-04-25T02:06:55.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.725 7f7861740700 1 -- 172.21.15.57:0/3817090818 wait complete. 2024-04-25T02:06:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.749 7f7861740700 1 Processor -- start 2024-04-25T02:06:55.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.749 7f7861740700 1 -- start start 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f7861740700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c0f19c0 0x7f785c0d6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f7861740700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0d6850 0x7f785c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f7861740700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0d6ca0 0x7f785c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f7861740700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0efc40 con 0x7f785c0d6ca0 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f7861740700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0efdf0 con 0x7f785c0d6850 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f7861740700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0cf7a0 con 0x7f785c0f19c0 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c0f19c0 0x7f785c0d6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c0f19c0 0x7f785c0d6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45280/0 (socket says 172.21.15.57:45280) 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 -- 172.21.15.57:0/2347963449 learned_addr learned my addr 172.21.15.57:0/2347963449 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785aced700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0d6ca0 0x7f785c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f7859ceb700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0d6850 0x7f785c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 -- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0d6850 msgr2=0x7f785c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0d6850 0x7f785c0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 -- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0d6ca0 msgr2=0x7f785c0ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0d6ca0 0x7f785c0ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 -- 172.21.15.57:0/2347963449 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0cea60 con 0x7f785c0f19c0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785aced700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0d6ca0 0x7f785c0ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.750 7f785a4ec700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c0f19c0 0x7f785c0d6220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f785c0c4b50 tx=0x7f784c0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.751 7f78537fe700 1 -- 172.21.15.57:0/2347963449 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f785c0cea60 con 0x7f785c0f19c0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.751 7f78537fe700 1 -- 172.21.15.57:0/2347963449 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c0119e0 con 0x7f785c0f19c0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.751 7f7861740700 1 -- 172.21.15.57:0/2347963449 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0ced20 con 0x7f785c0f19c0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.751 7f78537fe700 1 -- 172.21.15.57:0/2347963449 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f784c011db0 con 0x7f785c0f19c0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.751 7f7861740700 1 -- 172.21.15.57:0/2347963449 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c1b9820 con 0x7f785c0f19c0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.751 7f78537fe700 1 -- 172.21.15.57:0/2347963449 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f784c027460 con 0x7f785c0f19c0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.751 7f78537fe700 1 -- 172.21.15.57:0/2347963449 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f784c001b90 con 0x7f785c0f19c0 2024-04-25T02:06:55.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.752 7f7861740700 1 -- 172.21.15.57:0/2347963449 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c0c4740 con 0x7f785c0f19c0 2024-04-25T02:06:55.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.755 7f78537fe700 1 -- 172.21.15.57:0/2347963449 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f784c0117d0 con 0x7f785c0f19c0 2024-04-25T02:06:55.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.866 7f7861740700 1 -- 172.21.15.57:0/2347963449 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mgr", ""]}) v1 -- 0x7f785c087740 con 0x7f78400145b0 2024-04-25T02:06:55.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.867 7f78537fe700 1 -- 172.21.15.57:0/2347963449 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f784400b720 con 0x7f78400145b0 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 -- 172.21.15.57:0/2347963449 >> v1:172.21.15.57:6816/43033 conn(0x7f78400145b0 legacy=0x7f7840016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 -- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c0f19c0 msgr2=0x7f785c0d6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c0f19c0 0x7f785c0d6220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f785c0c4b50 tx=0x7f784c0068c0).stop 2024-04-25T02:06:55.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 -- 172.21.15.57:0/2347963449 shutdown_connections 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0d6ca0 0x7f785c0ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f785c0f19c0 0x7f785c0d6220 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 --2- 172.21.15.57:0/2347963449 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0d6850 0x7f785c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:55.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 -- 172.21.15.57:0/2347963449 >> 172.21.15.57:0/2347963449 conn(0x7f785c0c3b10 msgr2=0x7f785c0db0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:55.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 -- 172.21.15.57:0/2347963449 shutdown_connections 2024-04-25T02:06:55.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:55.868 7f7861740700 1 -- 172.21.15.57:0/2347963449 wait complete. 2024-04-25T02:06:55.878 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T02:06:55.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.009 7fe585d21700 1 Processor -- start 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.009 7fe585d21700 1 -- start start 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe585d21700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800f58a0 0x7fe5800f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe585d21700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5800f2290 0x7fe58010ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe585d21700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800f91b0 con 0x7fe5800f1e40 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe585d21700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58010f060 con 0x7fe5800f2290 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe585d21700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801ac600 con 0x7fe5800f58a0 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe57eab2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800f58a0 0x7fe5800f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe57e2b1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe5800f1e40 0x7fe58010e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37908/0 (socket says 172.21.15.57:37908) 2024-04-25T02:06:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe57e2b1700 1 -- 172.21.15.57:0/2706989070 learned_addr learned my addr 172.21.15.57:0/2706989070 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe57f2b3700 1 --2- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5800f2290 0x7fe58010ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.010 7fe57dab0700 1 -- 172.21.15.57:0/2706989070 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197322695 0 0) 0x7fe570001110 con 0x7fe5800f1e40 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57dab0700 1 -- 172.21.15.57:0/2706989070 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe560003270 con 0x7fe5800f1e40 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57f2b3700 1 -- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800f58a0 msgr2=0x7fe5800f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57f2b3700 1 --2- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800f58a0 0x7fe5800f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57f2b3700 1 -- 172.21.15.57:0/2706989070 >> v1:172.21.15.57:6789/0 conn(0x7fe5800f1e40 legacy=0x7fe58010e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57f2b3700 1 -- 172.21.15.57:0/2706989070 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5801ac7b0 con 0x7fe5800f2290 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57eab2700 1 --2- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800f58a0 0x7fe5800f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57f2b3700 1 --2- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5800f2290 0x7fe58010ea30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fe580103770 tx=0x7fe578009d70).ready entity=mon.1 client_cookie=e66d9fbbb470dd32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57dab0700 1 -- 172.21.15.57:0/2706989070 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5801ac7b0 con 0x7fe5800f2290 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57dab0700 1 -- 172.21.15.57:0/2706989070 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57800b7c0 con 0x7fe5800f2290 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe57dab0700 1 -- 172.21.15.57:0/2706989070 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe57800b9a0 con 0x7fe5800f2290 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe585d21700 1 -- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5800f2290 msgr2=0x7fe58010ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.011 7fe585d21700 1 --2- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5800f2290 0x7fe58010ea30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fe580103770 tx=0x7fe578009d70).stop 2024-04-25T02:06:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.012 7fe585d21700 1 -- 172.21.15.57:0/2706989070 shutdown_connections 2024-04-25T02:06:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.012 7fe585d21700 1 --2- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5800f2290 0x7fe58010ea30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.012 7fe585d21700 1 --2- 172.21.15.57:0/2706989070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800f58a0 0x7fe5800f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.012 7fe585d21700 1 -- 172.21.15.57:0/2706989070 >> 172.21.15.57:0/2706989070 conn(0x7fe5801139f0 msgr2=0x7fe5800f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.012 7fe585d21700 1 -- 172.21.15.57:0/2706989070 shutdown_connections 2024-04-25T02:06:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.012 7fe585d21700 1 -- 172.21.15.57:0/2706989070 wait complete. 2024-04-25T02:06:56.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.035 7fe585d21700 1 Processor -- start 2024-04-25T02:06:56.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe585d21700 1 -- start start 2024-04-25T02:06:56.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe585d21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5800d7660 0x7fe5800d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe585d21700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800d2140 0x7fe5801b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe585d21700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5801b4640 0x7fe5801b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe585d21700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580088f60 con 0x7fe5800d7660 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe585d21700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800d2590 con 0x7fe5801b4640 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe585d21700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801bb490 con 0x7fe5800d2140 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57eab2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5800d7660 0x7fe5800d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57f2b3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5801b4640 0x7fe5801b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57eab2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5800d7660 0x7fe5800d1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47504/0 (socket says 172.21.15.57:47504) 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57eab2700 1 -- 172.21.15.57:0/2467388686 learned_addr learned my addr 172.21.15.57:0/2467388686 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57e2b1700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800d2140 0x7fe5801b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57eab2700 1 -- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800d2140 msgr2=0x7fe5801b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57eab2700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800d2140 0x7fe5801b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57eab2700 1 -- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5801b4640 msgr2=0x7fe5801b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:56.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57eab2700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5801b4640 0x7fe5801b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57eab2700 1 -- 172.21.15.57:0/2467388686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5801bb640 con 0x7fe5800d7660 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.036 7fe57f2b3700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5801b4640 0x7fe5801b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.037 7fe57eab2700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5800d7660 0x7fe5800d1b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fe5800e6860 tx=0x7fe56800bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.037 7fe577fff700 1 -- 172.21.15.57:0/2467388686 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5801bb640 con 0x7fe5800d7660 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.037 7fe577fff700 1 -- 172.21.15.57:0/2467388686 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800c940 con 0x7fe5800d7660 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.037 7fe585d21700 1 -- 172.21.15.57:0/2467388686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5801bb840 con 0x7fe5800d7660 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.037 7fe577fff700 1 -- 172.21.15.57:0/2467388686 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe56800f040 con 0x7fe5800d7660 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.037 7fe585d21700 1 -- 172.21.15.57:0/2467388686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5801bbc20 con 0x7fe5800d7660 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.037 7fe577fff700 1 -- 172.21.15.57:0/2467388686 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fe568011070 con 0x7fe5800d7660 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.037 7fe577fff700 1 -- 172.21.15.57:0/2467388686 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fe568010040 con 0x7fe5800d7660 2024-04-25T02:06:56.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.038 7fe585d21700 1 -- 172.21.15.57:0/2467388686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5800f0860 con 0x7fe5800d7660 2024-04-25T02:06:56.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.041 7fe577fff700 1 -- 172.21.15.57:0/2467388686 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fe56800c540 con 0x7fe5800d7660 2024-04-25T02:06:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.148 7fe585d21700 1 -- 172.21.15.57:0/2467388686 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fe580087810 con 0x7fe5640145b0 2024-04-25T02:06:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.150 7fe577fff700 1 -- 172.21.15.57:0/2467388686 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32492 (unknown 2965378022 0 1511259327) 0x7fe570007cc0 con 0x7fe5640145b0 2024-04-25T02:06:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:06:56.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 -- 172.21.15.57:0/2467388686 >> v1:172.21.15.57:6816/43033 conn(0x7fe5640145b0 legacy=0x7fe564016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:56.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 -- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5800d7660 msgr2=0x7fe5800d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:56.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5800d7660 0x7fe5800d1b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fe5800e6860 tx=0x7fe56800bf70).stop 2024-04-25T02:06:56.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 -- 172.21.15.57:0/2467388686 shutdown_connections 2024-04-25T02:06:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe5801b4640 0x7fe5801b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5800d7660 0x7fe5800d1b10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 --2- 172.21.15.57:0/2467388686 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe5800d2140 0x7fe5801b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:06:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 -- 172.21.15.57:0/2467388686 >> 172.21.15.57:0/2467388686 conn(0x7fe5800dc350 msgr2=0x7fe5800c0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 -- 172.21.15.57:0/2467388686 shutdown_connections 2024-04-25T02:06:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:06:56.151 7fe585d21700 1 -- 172.21.15.57:0/2467388686 wait complete. 2024-04-25T02:06:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:06:56.168 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-04-25 02:06:54.679645","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195304,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292056,"statfs":{"total":386547056640,"available":382251065344,"internally_reserved":4294967296,"allocated":991232,"data_stored":305438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.786969"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.304393","last_change":"2024-04-25 02:05:38.743003","last_active":"2024-04-25 02:06:47.304393","last_peered":"2024-04-25 02:06:47.304393","last_clean":"2024-04-25 02:06:47.304393","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:47.304393","last_undegraded":"2024-04-25 02:06:47.304393","last_fullsized":"2024-04-25 02:06:47.304393","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.557661","last_change":"2024-04-25 02:05:38.744141","last_active":"2024-04-25 02:06:33.557661","last_peered":"2024-04-25 02:06:33.557661","last_clean":"2024-04-25 02:06:33.557661","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:06:33.557661","last_undegraded":"2024-04-25 02:06:33.557661","last_fullsized":"2024-04-25 02:06:33.557661","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.300953","last_change":"2024-04-25 02:05:38.743287","last_active":"2024-04-25 02:06:47.300953","last_peered":"2024-04-25 02:06:47.300953","last_clean":"2024-04-25 02:06:47.300953","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:06:47.300953","last_undegraded":"2024-04-25 02:06:47.300953","last_fullsized":"2024-04-25 02:06:47.300953","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.302631","last_change":"2024-04-25 02:05:38.742257","last_active":"2024-04-25 02:06:47.302631","last_peered":"2024-04-25 02:06:47.302631","last_clean":"2024-04-25 02:06:47.302631","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:06:47.302631","last_undegraded":"2024-04-25 02:06:47.302631","last_fullsized":"2024-04-25 02:06:47.302631","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.300538","last_change":"2024-04-25 02:05:38.741544","last_active":"2024-04-25 02:06:47.300538","last_peered":"2024-04-25 02:06:47.300538","last_clean":"2024-04-25 02:06:47.300538","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:06:47.300538","last_undegraded":"2024-04-25 02:06:47.300538","last_fullsized":"2024-04-25 02:06:47.300538","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.558047","last_change":"2024-04-25 02:05:38.741595","last_active":"2024-04-25 02:06:33.558047","last_peered":"2024-04-25 02:06:33.558047","last_clean":"2024-04-25 02:06:33.558047","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:06:33.558047","last_undegraded":"2024-04-25 02:06:33.558047","last_fullsized":"2024-04-25 02:06:33.558047","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2024-04-25 02:06:33.557718","last_change":"2024-04-25 02:05:38.743675","last_active":"2024-04-25 02:06:33.557718","last_peered":"2024-04-25 02:06:33.557718","last_clean":"2024-04-25 02:06:33.557718","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:06:33.557718","last_undegraded":"2024-04-25 02:06:33.557718","last_fullsized":"2024-04-25 02:06:33.557718","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2024-04-25 02:06:47.301597","last_change":"2024-04-25 02:05:38.741614","last_active":"2024-04-25 02:06:47.301597","last_peered":"2024-04-25 02:06:47.301597","last_clean":"2024-04-25 02:06:47.301597","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:06:47.301597","last_undegraded":"2024-04-25 02:06:47.301597","last_fullsized":"2024-04-25 02:06:47.301597","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:05:37.717067","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:05:37.717067","last_clean_scrub_stamp":"2024-04-25 02:05:37.717067","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705681,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":79173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.224}]},{"osd":1,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.31},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.23400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":78427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":3.2770000000000001,"5min":3.2770000000000001,"15min":3.2770000000000001},"last":0.22800000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.4260000000000002,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":6.2469999999999999,"5min":6.2469999999999999,"15min":6.2469999999999999},"last":0.251}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.26400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":73636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.317}]},{"osd":2,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.218}]},{"osd":3,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.23400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":74202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.246}]},{"osd":2,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.316}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.32500000000000001}]}]}]}} 2024-04-25T02:06:56.171 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-25 02:05:37.717067 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=5, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=6, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:06:56.171 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-25 02:05:37.717067 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=5, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=6, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:06:56.171 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-25 02:05:37.717067 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=5, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=6, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:06:56.171 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-25 02:05:37.717067 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=5, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=6, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:06:56.171 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25 02:05:37.717067 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=5, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=6, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:06:56.172 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-25 02:05:37.717067 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=5, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=6, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:06:56.172 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-25 02:05:37.717067 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=5, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=6, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:06:56.172 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-25 02:05:37.717067 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=5, tm_sec=37, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=6, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:06:56.172 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:07:16.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f117ea23700 1 Processor -- start 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f117ea23700 1 -- start start 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f117ea23700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11780f58a0 0x7f117810c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f117ea23700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f117810c8f0 0x7f11780f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f117ea23700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11780f2640 con 0x7f117810cd40 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f117ea23700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11780fa210 con 0x7f11780f58a0 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f117ea23700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11780f9540 con 0x7f117810c8f0 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f1177fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f117810cd40 0x7f11780f1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40718/0 (socket says 172.21.15.57:40718) 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f1177fff700 1 -- 172.21.15.57:0/3085639472 learned_addr learned my addr 172.21.15.57:0/3085639472 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f1176ffd700 1 --2- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f117810c8f0 0x7f11780f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f11777fe700 1 --2- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11780f58a0 0x7f117810c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.313 7f11767fc700 1 -- 172.21.15.57:0/3085639472 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743984208 0 0) 0x7f1170001110 con 0x7f117810cd40 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f11777fe700 1 -- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f117810c8f0 msgr2=0x7f11780f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f11777fe700 1 --2- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f117810c8f0 0x7f11780f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f11777fe700 1 -- 172.21.15.57:0/3085639472 >> v1:172.21.15.57:6789/0 conn(0x7f117810cd40 legacy=0x7f11780f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f11777fe700 1 -- 172.21.15.57:0/3085639472 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11781aa560 con 0x7f11780f58a0 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f1176ffd700 1 --2- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f117810c8f0 0x7f11780f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f11777fe700 1 --2- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11780f58a0 0x7f117810c2c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f11680032f0 tx=0x7f1168009d40).ready entity=mon.1 client_cookie=3648fcd30a79c8f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f11767fc700 1 -- 172.21.15.57:0/3085639472 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11781aa560 con 0x7f11780f58a0 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f11767fc700 1 -- 172.21.15.57:0/3085639472 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116800b800 con 0x7f11780f58a0 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f11767fc700 1 -- 172.21.15.57:0/3085639472 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f116800b9e0 con 0x7f11780f58a0 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f117ea23700 1 -- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11780f58a0 msgr2=0x7f117810c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.314 7f117ea23700 1 --2- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11780f58a0 0x7f117810c2c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f11680032f0 tx=0x7f1168009d40).stop 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.315 7f117ea23700 1 -- 172.21.15.57:0/3085639472 shutdown_connections 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.315 7f117ea23700 1 --2- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11780f58a0 0x7f117810c2c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.315 7f117ea23700 1 --2- 172.21.15.57:0/3085639472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f117810c8f0 0x7f11780f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.315 7f117ea23700 1 -- 172.21.15.57:0/3085639472 >> 172.21.15.57:0/3085639472 conn(0x7f11781139f0 msgr2=0x7f11780f50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:16.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.315 7f117ea23700 1 -- 172.21.15.57:0/3085639472 shutdown_connections 2024-04-25T02:07:16.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.315 7f117ea23700 1 -- 172.21.15.57:0/3085639472 wait complete. 2024-04-25T02:07:16.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.338 7f117ea23700 1 Processor -- start 2024-04-25T02:07:16.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f117ea23700 1 -- start start 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f117ea23700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11781a67f0 0x7f11781ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f117ea23700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11781ade40 0x7f11781b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f117ea23700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11781ae290 0x7f11781b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f117ea23700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11780f8090 con 0x7f11781a67f0 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f117ea23700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11781a6e20 con 0x7f11781ade40 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f117ea23700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11781a7050 con 0x7f11781ae290 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f1177fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11781ae290 0x7f11781b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f1176ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11781ade40 0x7f11781b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f1177fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11781ae290 0x7f11781b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40584/0 (socket says 172.21.15.57:40584) 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f1176ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11781ade40 0x7f11781b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:55690/0 (socket says 172.21.15.57:55690) 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f11777fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11781a67f0 0x7f11781ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f1177fff700 1 -- 172.21.15.57:0/1179146272 learned_addr learned my addr 172.21.15.57:0/1179146272 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.339 7f1177fff700 1 -- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11781ade40 msgr2=0x7f11781b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1177fff700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11781ade40 0x7f11781b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1177fff700 1 -- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11781a67f0 msgr2=0x7f11781ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1177fff700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11781a67f0 0x7f11781ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1177fff700 1 -- 172.21.15.57:0/1179146272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11781b4ee0 con 0x7f11781ae290 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1176ffd700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11781ade40 0x7f11781b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f11777fe700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11781a67f0 0x7f11781ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1177fff700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11781ae290 0x7f11781b48b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f11780c5250 tx=0x7f117000c7e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1174ff9700 1 -- 172.21.15.57:0/1179146272 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11781b4ee0 con 0x7f11781ae290 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1174ff9700 1 -- 172.21.15.57:0/1179146272 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000ce10 con 0x7f11781ae290 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f117ea23700 1 -- 172.21.15.57:0/1179146272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11781b51a0 con 0x7f11781ae290 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f1174ff9700 1 -- 172.21.15.57:0/1179146272 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1170005030 con 0x7f11781ae290 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.340 7f117ea23700 1 -- 172.21.15.57:0/1179146272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11781a24e0 con 0x7f11781ae290 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.341 7f1174ff9700 1 -- 172.21.15.57:0/1179146272 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f1170005230 con 0x7f11781ae290 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.341 7f1174ff9700 1 -- 172.21.15.57:0/1179146272 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f117000b780 con 0x7f11781ae290 2024-04-25T02:07:16.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.341 7f117ea23700 1 -- 172.21.15.57:0/1179146272 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11780f0860 con 0x7f11781ae290 2024-04-25T02:07:16.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.344 7f1174ff9700 1 -- 172.21.15.57:0/1179146272 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f1170007110 con 0x7f11781ae290 2024-04-25T02:07:16.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.450 7f117ea23700 1 -- 172.21.15.57:0/1179146272 --> v1:172.21.15.57:6816/43033 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f1178087810 con 0x7f11580145b0 2024-04-25T02:07:16.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.451 7f1174ff9700 1 -- 172.21.15.57:0/1179146272 <== mgr.4100 v1:172.21.15.57:6816/43033 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+32464 (unknown 2965378022 0 4234273126) 0x7f116800bbc0 con 0x7f11580145b0 2024-04-25T02:07:16.458 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.452 7f117ea23700 1 -- 172.21.15.57:0/1179146272 >> v1:172.21.15.57:6816/43033 conn(0x7f11580145b0 legacy=0x7f1158016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.452 7f117ea23700 1 -- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11781ae290 msgr2=0x7f11781b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.452 7f117ea23700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11781ae290 0x7f11781b48b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f11780c5250 tx=0x7f117000c7e0).stop 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.452 7f117ea23700 1 -- 172.21.15.57:0/1179146272 shutdown_connections 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.453 7f117ea23700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11781ae290 0x7f11781b48b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.453 7f117ea23700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11781a67f0 0x7f11781ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.453 7f117ea23700 1 --2- 172.21.15.57:0/1179146272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11781ade40 0x7f11781b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.453 7f117ea23700 1 -- 172.21.15.57:0/1179146272 >> 172.21.15.57:0/1179146272 conn(0x7f11780c8e80 msgr2=0x7f11780d62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.453 7f117ea23700 1 -- 172.21.15.57:0/1179146272 shutdown_connections 2024-04-25T02:07:16.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.453 7f117ea23700 1 -- 172.21.15.57:0/1179146272 wait complete. 2024-04-25T02:07:16.460 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T02:07:16.469 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-25 02:07:14.683894","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4195344,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292016,"statfs":{"total":386547056640,"available":382251024384,"internally_reserved":4294967296,"allocated":1015808,"data_stored":319928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2286,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.786969"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-04-25 02:06:57.221375","last_change":"2024-04-25 02:06:57.221449","last_active":"2024-04-25 02:06:57.221375","last_peered":"2024-04-25 02:06:57.221375","last_clean":"2024-04-25 02:06:57.221375","last_became_active":"2024-04-25 02:05:38.742640","last_became_peered":"2024-04-25 02:05:38.742640","last_unstale":"2024-04-25 02:06:57.221375","last_undegraded":"2024-04-25 02:06:57.221375","last_fullsized":"2024-04-25 02:06:57.221375","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:06:57.221374","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:06:57.221374","last_clean_scrub_stamp":"2024-04-25 02:06:57.221374","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-04-25 02:07:02.009526","last_change":"2024-04-25 02:07:02.009599","last_active":"2024-04-25 02:07:02.009526","last_peered":"2024-04-25 02:07:02.009526","last_clean":"2024-04-25 02:07:02.009526","last_became_active":"2024-04-25 02:05:38.743776","last_became_peered":"2024-04-25 02:05:38.743776","last_unstale":"2024-04-25 02:07:02.009526","last_undegraded":"2024-04-25 02:07:02.009526","last_fullsized":"2024-04-25 02:07:02.009526","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:07:02.009526","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:07:02.009526","last_clean_scrub_stamp":"2024-04-25 02:07:02.009526","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-04-25 02:07:07.005540","last_change":"2024-04-25 02:07:07.005599","last_active":"2024-04-25 02:07:07.005540","last_peered":"2024-04-25 02:07:07.005540","last_clean":"2024-04-25 02:07:07.005540","last_became_active":"2024-04-25 02:05:38.742929","last_became_peered":"2024-04-25 02:05:38.742929","last_unstale":"2024-04-25 02:07:07.005540","last_undegraded":"2024-04-25 02:07:07.005540","last_fullsized":"2024-04-25 02:07:07.005540","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:07:07.005539","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:07:07.005539","last_clean_scrub_stamp":"2024-04-25 02:07:07.005539","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-04-25 02:07:05.718660","last_change":"2024-04-25 02:07:05.718721","last_active":"2024-04-25 02:07:05.718660","last_peered":"2024-04-25 02:07:05.718660","last_clean":"2024-04-25 02:07:05.718660","last_became_active":"2024-04-25 02:05:38.741904","last_became_peered":"2024-04-25 02:05:38.741904","last_unstale":"2024-04-25 02:07:05.718660","last_undegraded":"2024-04-25 02:07:05.718660","last_fullsized":"2024-04-25 02:07:05.718660","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:07:05.718659","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:07:05.718659","last_clean_scrub_stamp":"2024-04-25 02:07:05.718659","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-04-25 02:07:04.060322","last_change":"2024-04-25 02:07:04.060378","last_active":"2024-04-25 02:07:04.060322","last_peered":"2024-04-25 02:07:04.060322","last_clean":"2024-04-25 02:07:04.060322","last_became_active":"2024-04-25 02:05:38.741130","last_became_peered":"2024-04-25 02:05:38.741130","last_unstale":"2024-04-25 02:07:04.060322","last_undegraded":"2024-04-25 02:07:04.060322","last_fullsized":"2024-04-25 02:07:04.060322","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:07:04.060322","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:07:04.060322","last_clean_scrub_stamp":"2024-04-25 02:07:04.060322","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-04-25 02:07:00.062197","last_change":"2024-04-25 02:07:00.062255","last_active":"2024-04-25 02:07:00.062197","last_peered":"2024-04-25 02:07:00.062197","last_clean":"2024-04-25 02:07:00.062197","last_became_active":"2024-04-25 02:05:38.741185","last_became_peered":"2024-04-25 02:05:38.741185","last_unstale":"2024-04-25 02:07:00.062197","last_undegraded":"2024-04-25 02:07:00.062197","last_fullsized":"2024-04-25 02:07:00.062197","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:07:00.062197","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:07:00.062197","last_clean_scrub_stamp":"2024-04-25 02:07:00.062197","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2024-04-25 02:07:03.951357","last_change":"2024-04-25 02:07:03.951435","last_active":"2024-04-25 02:07:03.951357","last_peered":"2024-04-25 02:07:03.951357","last_clean":"2024-04-25 02:07:03.951357","last_became_active":"2024-04-25 02:05:38.743342","last_became_peered":"2024-04-25 02:05:38.743342","last_unstale":"2024-04-25 02:07:03.951357","last_undegraded":"2024-04-25 02:07:03.951357","last_fullsized":"2024-04-25 02:07:03.951357","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:07:03.951357","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:07:03.951357","last_clean_scrub_stamp":"2024-04-25 02:07:03.951357","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"28","reported_epoch":"28","state":"active+clean","last_fresh":"2024-04-25 02:07:07.992263","last_change":"2024-04-25 02:07:07.992321","last_active":"2024-04-25 02:07:07.992263","last_peered":"2024-04-25 02:07:07.992263","last_clean":"2024-04-25 02:07:07.992263","last_became_active":"2024-04-25 02:05:38.741199","last_became_peered":"2024-04-25 02:05:38.741199","last_unstale":"2024-04-25 02:07:07.992263","last_undegraded":"2024-04-25 02:07:07.992263","last_fullsized":"2024-04-25 02:07:07.992263","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25 02:07:07.992263","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25 02:07:07.992263","last_clean_scrub_stamp":"2024-04-25 02:07:07.992263","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705685,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"last":0.255},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.30099999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705686,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":3.2770000000000001,"5min":3.2770000000000001,"15min":3.2770000000000001},"last":0.312}]},{"osd":1,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":4.4260000000000002,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":6.2469999999999999,"5min":6.2469999999999999,"15min":6.2469999999999999},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.247},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.33800000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705686,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.318}]},{"osd":2,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.311}]}]},{"osd":1,"up_from":9,"seq":38654705686,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":79982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.435,"5min":0.435,"15min":0.435},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.31}]},{"osd":3,"last update":"Thu Apr 25 02:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.34300000000000003}]}]}]}} 2024-04-25T02:07:16.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T02:07:16.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b66ad6700 1 Processor -- start 2024-04-25T02:07:16.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b66ad6700 1 -- start start 2024-04-25T02:07:16.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b66ad6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b601064b0 0x7f9b6010e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b66ad6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b6010ee60 0x7f9b600f1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b66ad6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b600f1db0 con 0x7f9b6010ea10 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b66ad6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b600fb5f0 con 0x7f9b601064b0 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b66ad6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60106900 con 0x7f9b6010ee60 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b5ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b6010ee60 0x7f9b600f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.596 7f9b5f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b601064b0 0x7f9b6010e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b6010ee60 0x7f9b600f1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40588/0 (socket says 172.21.15.57:40588) 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b601064b0 0x7f9b6010e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52340/0 (socket says 172.21.15.57:52340) 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5ffff700 1 -- 172.21.15.57:0/3262602327 learned_addr learned my addr 172.21.15.57:0/3262602327 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9b6010ea10 0x7f9b600f0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40734/0 (socket says 172.21.15.57:40734) 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5f7fe700 1 -- 172.21.15.57:0/3262602327 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b6010ee60 msgr2=0x7f9b600f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5f7fe700 1 --2- 172.21.15.57:0/3262602327 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b6010ee60 0x7f9b600f1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5f7fe700 1 -- 172.21.15.57:0/3262602327 >> v1:172.21.15.57:6789/0 conn(0x7f9b6010ea10 legacy=0x7f9b600f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5f7fe700 1 -- 172.21.15.57:0/3262602327 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b601ac740 con 0x7f9b601064b0 2024-04-25T02:07:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5ffff700 1 --2- 172.21.15.57:0/3262602327 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b6010ee60 0x7f9b600f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5f7fe700 1 --2- 172.21.15.57:0/3262602327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b601064b0 0x7f9b6010e3e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f9b600f56d0 tx=0x7f9b5000ba20).ready entity=mon.0 client_cookie=528127b970aac359 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5e7fc700 1 -- 172.21.15.57:0/3262602327 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b601ac740 con 0x7f9b601064b0 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5e7fc700 1 -- 172.21.15.57:0/3262602327 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000d5c0 con 0x7f9b601064b0 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b5e7fc700 1 -- 172.21.15.57:0/3262602327 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b5000d990 con 0x7f9b601064b0 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b66ad6700 1 -- 172.21.15.57:0/3262602327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b601064b0 msgr2=0x7f9b6010e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.597 7f9b66ad6700 1 --2- 172.21.15.57:0/3262602327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b601064b0 0x7f9b6010e3e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f9b600f56d0 tx=0x7f9b5000ba20).stop 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.598 7f9b66ad6700 1 -- 172.21.15.57:0/3262602327 shutdown_connections 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.598 7f9b66ad6700 1 --2- 172.21.15.57:0/3262602327 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b6010ee60 0x7f9b600f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.598 7f9b66ad6700 1 --2- 172.21.15.57:0/3262602327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b601064b0 0x7f9b6010e3e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.598 7f9b66ad6700 1 -- 172.21.15.57:0/3262602327 >> 172.21.15.57:0/3262602327 conn(0x7f9b601148c0 msgr2=0x7f9b60114d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.598 7f9b66ad6700 1 -- 172.21.15.57:0/3262602327 shutdown_connections 2024-04-25T02:07:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.598 7f9b66ad6700 1 -- 172.21.15.57:0/3262602327 wait complete. 2024-04-25T02:07:16.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.621 7f9b66ad6700 1 Processor -- start 2024-04-25T02:07:16.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b66ad6700 1 -- start start 2024-04-25T02:07:16.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b66ad6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b600d7fe0 0x7f9b600d5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b66ad6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b600d6620 0x7f9b601b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b66ad6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b600d6a70 0x7f9b601b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b66ad6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600f0090 con 0x7f9b600d7fe0 2024-04-25T02:07:16.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b66ad6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600ddf80 con 0x7f9b600d6a70 2024-04-25T02:07:16.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b66ad6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600d7980 con 0x7f9b600d6620 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b600d7fe0 0x7f9b600d5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b600d6a70 0x7f9b601b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5effd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b600d6620 0x7f9b601b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b600d7fe0 0x7f9b600d5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52346/0 (socket says 172.21.15.57:52346) 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b600d6a70 0x7f9b601b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:55696/0 (socket says 172.21.15.57:55696) 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5effd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b600d6620 0x7f9b601b4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:40594/0 (socket says 172.21.15.57:40594) 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5f7fe700 1 -- 172.21.15.57:0/2476092292 learned_addr learned my addr 172.21.15.57:0/2476092292 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5f7fe700 1 -- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b600d6620 msgr2=0x7f9b601b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.622 7f9b5f7fe700 1 --2- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b600d6620 0x7f9b601b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5f7fe700 1 -- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b600d6a70 msgr2=0x7f9b601b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5f7fe700 1 --2- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b600d6a70 0x7f9b601b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5f7fe700 1 -- 172.21.15.57:0/2476092292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b601b4db0 con 0x7f9b600d7fe0 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5f7fe700 1 --2- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b600d7fe0 0x7f9b600d5ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f9b600d7530 tx=0x7f9b500068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5cff9700 1 -- 172.21.15.57:0/2476092292 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b601b4db0 con 0x7f9b600d7fe0 2024-04-25T02:07:16.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5cff9700 1 -- 172.21.15.57:0/2476092292 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b500119c0 con 0x7f9b600d7fe0 2024-04-25T02:07:16.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5cff9700 1 -- 172.21.15.57:0/2476092292 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b50011d90 con 0x7f9b600d7fe0 2024-04-25T02:07:16.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b601b5070 con 0x7f9b600d7fe0 2024-04-25T02:07:16.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b601bbb30 con 0x7f9b600d7fe0 2024-04-25T02:07:16.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5cff9700 1 -- 172.21.15.57:0/2476092292 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7f9b50027460 con 0x7f9b600d7fe0 2024-04-25T02:07:16.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.623 7f9b5cff9700 1 -- 172.21.15.57:0/2476092292 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7f9b50021b70 con 0x7f9b600d7fe0 2024-04-25T02:07:16.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.624 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b600f0860 con 0x7f9b600d7fe0 2024-04-25T02:07:16.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.627 7f9b5cff9700 1 -- 172.21.15.57:0/2476092292 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7f9b500117b0 con 0x7f9b600d7fe0 2024-04-25T02:07:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.740 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9b600d7770 con 0x7f9b600d7fe0 2024-04-25T02:07:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.742 7f9b5cff9700 1 -- 172.21.15.57:0/2476092292 <== mon.0 v2:172.21.15.57:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9b50006950 con 0x7f9b600d7fe0 2024-04-25T02:07:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.742 7f9b5cff9700 1 -- 172.21.15.57:0/2476092292 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v4)=0 v4) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9b5000d3b0 con 0x7f9b600d7fe0 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.744 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 >> v1:172.21.15.57:6816/43033 conn(0x7f9b440145b0 legacy=0x7f9b44016b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.744 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b600d7fe0 msgr2=0x7f9b600d5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.744 7f9b66ad6700 1 --2- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b600d7fe0 0x7f9b600d5ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f9b600d7530 tx=0x7f9b500068c0).stop 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.744 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 shutdown_connections 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.744 7f9b66ad6700 1 --2- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b600d6a70 0x7f9b601b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.744 7f9b66ad6700 1 --2- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b600d7fe0 0x7f9b600d5ff0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.744 7f9b66ad6700 1 --2- 172.21.15.57:0/2476092292 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9b600d6620 0x7f9b601b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.744 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 >> 172.21.15.57:0/2476092292 conn(0x7f9b600c9dc0 msgr2=0x7f9b600ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.745 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 shutdown_connections 2024-04-25T02:07:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.745 7f9b66ad6700 1 -- 172.21.15.57:0/2476092292 wait complete. 2024-04-25T02:07:16.762 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:07:16.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:16.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c8a5a700 1 Processor -- start 2024-04-25T02:07:16.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c8a5a700 1 -- start start 2024-04-25T02:07:16.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c8a5a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40f5920 0x7fb7c40f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c8a5a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7c40f2310 0x7fb7c410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c8a5a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c40f9230 con 0x7fb7c40f1ec0 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c8a5a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c410f0e0 con 0x7fb7c40f2310 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c8a5a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c41ac680 con 0x7fb7c40f5920 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c1850700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40f5920 0x7fb7c40f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.888 7fb7c2051700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7c40f2310 0x7fb7c410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c104f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb7c40f1ec0 0x7fb7c410e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40748/0 (socket says 172.21.15.57:40748) 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c104f700 1 -- 172.21.15.57:0/3026459653 learned_addr learned my addr 172.21.15.57:0/3026459653 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c2051700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7c40f2310 0x7fb7c410eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52352/0 (socket says 172.21.15.57:52352) 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c1850700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40f5920 0x7fb7c40f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:55710/0 (socket says 172.21.15.57:55710) 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c084e700 1 -- 172.21.15.57:0/3026459653 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964692468 0 0) 0x7fb7b8001110 con 0x7fb7c40f1ec0 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c1850700 1 -- 172.21.15.57:0/3026459653 >> v2:172.21.15.57:3300/0 conn(0x7fb7c40f2310 msgr2=0x7fb7c410eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c1850700 1 --2- 172.21.15.57:0/3026459653 >> v2:172.21.15.57:3300/0 conn(0x7fb7c40f2310 0x7fb7c410eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c1850700 1 -- 172.21.15.57:0/3026459653 >> v1:172.21.15.57:6789/0 conn(0x7fb7c40f1ec0 legacy=0x7fb7c410e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c1850700 1 -- 172.21.15.57:0/3026459653 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c41ac830 con 0x7fb7c40f5920 2024-04-25T02:07:16.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c2051700 1 --2- 172.21.15.57:0/3026459653 >> v2:172.21.15.57:3300/0 conn(0x7fb7c40f2310 0x7fb7c410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c1850700 1 --2- 172.21.15.57:0/3026459653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40f5920 0x7fb7c40f1890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb7b4002f70 tx=0x7fb7b400b970).ready entity=mon.1 client_cookie=de1234c102457711 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c084e700 1 -- 172.21.15.57:0/3026459653 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb7c41ac830 con 0x7fb7c40f5920 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c084e700 1 -- 172.21.15.57:0/3026459653 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb7b400d5c0 con 0x7fb7c40f5920 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c084e700 1 -- 172.21.15.57:0/3026459653 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb7b400d990 con 0x7fb7c40f5920 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c8a5a700 1 -- 172.21.15.57:0/3026459653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40f5920 msgr2=0x7fb7c40f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.889 7fb7c8a5a700 1 --2- 172.21.15.57:0/3026459653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40f5920 0x7fb7c40f1890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb7b4002f70 tx=0x7fb7b400b970).stop 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.890 7fb7c8a5a700 1 -- 172.21.15.57:0/3026459653 shutdown_connections 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.890 7fb7c8a5a700 1 --2- 172.21.15.57:0/3026459653 >> v2:172.21.15.57:3300/0 conn(0x7fb7c40f2310 0x7fb7c410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.890 7fb7c8a5a700 1 --2- 172.21.15.57:0/3026459653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40f5920 0x7fb7c40f1890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.890 7fb7c8a5a700 1 -- 172.21.15.57:0/3026459653 >> 172.21.15.57:0/3026459653 conn(0x7fb7c4113a70 msgr2=0x7fb7c40f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.890 7fb7c8a5a700 1 -- 172.21.15.57:0/3026459653 shutdown_connections 2024-04-25T02:07:16.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.890 7fb7c8a5a700 1 -- 172.21.15.57:0/3026459653 wait complete. 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c8a5a700 1 Processor -- start 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c8a5a700 1 -- start start 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c8a5a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40c4b70 0x7fb7c40c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c8a5a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c40c25c0 0x7fb7c40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c8a5a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb7c40c2a10 0x7fb7c40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c8a5a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40e64a0 con 0x7fb7c40c25c0 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c8a5a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40cf580 con 0x7fb7c40c4b70 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c8a5a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40c9070 con 0x7fb7c40c2a10 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c1850700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40c4b70 0x7fb7c40c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c104f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c40c25c0 0x7fb7c40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c2051700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb7c40c2a10 0x7fb7c40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c104f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c40c25c0 0x7fb7c40cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52366/0 (socket says 172.21.15.57:52366) 2024-04-25T02:07:16.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c1850700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40c4b70 0x7fb7c40c1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:55718/0 (socket says 172.21.15.57:55718) 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.914 7fb7c104f700 1 -- 172.21.15.57:0/2036925806 learned_addr learned my addr 172.21.15.57:0/2036925806 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c104f700 1 -- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb7c40c2a10 msgr2=0x7fb7c40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c104f700 1 --2- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb7c40c2a10 0x7fb7c40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c104f700 1 -- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40c4b70 msgr2=0x7fb7c40c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c104f700 1 --2- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40c4b70 0x7fb7c40c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c104f700 1 -- 172.21.15.57:0/2036925806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40c5830 con 0x7fb7c40c25c0 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c2051700 1 --2- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb7c40c2a10 0x7fb7c40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c104f700 1 --2- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c40c25c0 0x7fb7c40cc890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fb7c40cda50 tx=0x7fb7b800c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7b2ffd700 1 -- 172.21.15.57:0/2036925806 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb7c40c5830 con 0x7fb7c40c25c0 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7b2ffd700 1 -- 172.21.15.57:0/2036925806 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb7b800ce00 con 0x7fb7c40c25c0 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7b2ffd700 1 -- 172.21.15.57:0/2036925806 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb7b8005620 con 0x7fb7c40c25c0 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c40cd4f0 con 0x7fb7c40c25c0 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c41bbbc0 con 0x7fb7c40c25c0 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.915 7fb7b2ffd700 1 -- 172.21.15.57:0/2036925806 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 3) v1 ==== 14991+0+0 (secure 0 0 0) 0x7fb7b801b070 con 0x7fb7c40c25c0 2024-04-25T02:07:16.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.916 7fb7b2ffd700 1 -- 172.21.15.57:0/2036925806 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2417+0+0 (secure 0 0 0) 0x7fb7b8004dd0 con 0x7fb7c40c25c0 2024-04-25T02:07:16.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.916 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c40f08e0 con 0x7fb7c40c25c0 2024-04-25T02:07:16.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:16.919 7fb7b2ffd700 1 -- 172.21.15.57:0/2036925806 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+110455 (secure 0 0 0) 0x7fb7b80070d0 con 0x7fb7c40c25c0 2024-04-25T02:07:17.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.062 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7c41aea10 con 0x7fb7c40c25c0 2024-04-25T02:07:17.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.062 7fb7b2ffd700 1 -- 172.21.15.57:0/2036925806 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+778 (secure 0 0 0) 0x7fb7b8000c30 con 0x7fb7c40c25c0 2024-04-25T02:07:17.069 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T02:07:17.069 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4954,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6817/814043690","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":814043690}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":14}],"filesystems":[]} 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.063 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 >> v1:172.21.15.57:6816/43033 conn(0x7fb7a00146a0 legacy=0x7fb7a0016bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.063 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c40c25c0 msgr2=0x7fb7c40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.063 7fb7c8a5a700 1 --2- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c40c25c0 0x7fb7c40cc890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fb7c40cda50 tx=0x7fb7b800c890).stop 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.063 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 shutdown_connections 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.063 7fb7c8a5a700 1 --2- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb7c40c2a10 0x7fb7c40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.063 7fb7c8a5a700 1 --2- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb7c40c4b70 0x7fb7c40c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.063 7fb7c8a5a700 1 --2- 172.21.15.57:0/2036925806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c40c25c0 0x7fb7c40cc890 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.063 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 >> 172.21.15.57:0/2036925806 conn(0x7fb7c40dc680 msgr2=0x7fb7c40d87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.064 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 shutdown_connections 2024-04-25T02:07:17.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25 02:07:17.064 7fb7c8a5a700 1 -- 172.21.15.57:0/2036925806 wait complete. 2024-04-25T02:07:17.071 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-04-25T02:07:17.080 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T02:07:17.081 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T02:07:17.081 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:07:17.081 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.089 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:07:17.089 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T02:07:17.089 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T02:07:17.089 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.151 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T02:07:17.151 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T02:07:17.151 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.217 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T02:07:17.217 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T02:07:17.217 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.288 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T02:07:17.288 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T02:07:17.288 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.355 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T02:07:17.355 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T02:07:17.355 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T02:07:17.355 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.415 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T02:07:17.415 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T02:07:17.415 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T02:07:17.415 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.465 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T02:07:17.465 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T02:07:17.465 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.515 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T02:07:17.515 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T02:07:17.515 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:07:17.565 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T02:07:17.565 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T02:07:17.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-25T02:07:17.643 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:07:17.643 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T02:07:17.898 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:07:17.898 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T02:07:17.991 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:07:17.991 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T02:07:18.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:07:18.062 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T02:07:18.125 INFO:tasks.ceph:Archiving mon data... 2024-04-25T02:07:18.126 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/data/mon.a.tgz 2024-04-25T02:07:18.127 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-25T02:07:18.145 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.PSr7fRRVt2 2024-04-25T02:07:18.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PSr7fRRVt2 2024-04-25T02:07:18.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.PSr7fRRVt2 2024-04-25T02:07:18.411 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.PSr7fRRVt2 is 250KB 2024-04-25T02:07:18.509 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.PSr7fRRVt2 2024-04-25T02:07:18.528 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/data/mon.b.tgz 2024-04-25T02:07:18.528 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-25T02:07:18.585 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.LDNYdtiS2q 2024-04-25T02:07:18.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LDNYdtiS2q 2024-04-25T02:07:18.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.LDNYdtiS2q 2024-04-25T02:07:18.816 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.LDNYdtiS2q is 330KB 2024-04-25T02:07:18.911 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.LDNYdtiS2q 2024-04-25T02:07:18.929 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/data/mon.c.tgz 2024-04-25T02:07:18.930 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-25T02:07:18.987 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.Q3I5Npc4B9 2024-04-25T02:07:18.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Q3I5Npc4B9 2024-04-25T02:07:19.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.Q3I5Npc4B9 2024-04-25T02:07:19.217 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.Q3I5Npc4B9 is 330KB 2024-04-25T02:07:19.312 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.Q3I5Npc4B9 2024-04-25T02:07:19.330 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T02:07:19.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:07:19.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:07:19.470 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:07:19.515 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:07:19.516 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T02:07:19.518 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/remote/smithi057/crash 2024-04-25T02:07:19.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:07:19.546 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/remote/smithi088/crash 2024-04-25T02:07:19.547 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:07:19.631 INFO:tasks.ceph:Compressing logs... 2024-04-25T02:07:19.631 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:07:19.633 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:07:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53064.log 2024-04-25T02:07:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45187.log 2024-04-25T02:07:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2024-04-25T02:07:19.687 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45187.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53064.log.gz 2024-04-25T02:07:19.687 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43628.log 2024-04-25T02:07:19.687 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45187.log.gz 2024-04-25T02:07:19.687 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46564.log 2024-04-25T02:07:19.687 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43628.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43628.log.gz 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48264.log 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46564.log: /var/log/ceph/ceph-client.admin.45748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46564.log.gz 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48060.log 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48264.log.gz 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50396.log 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:gzip /var/log/ceph/ceph-client.admin.48060.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49664.log 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48060.log.gz 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50396.log.gz 2024-04-25T02:07:19.688 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49163.log 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52860.log 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49664.log.gz 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52604.log 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49163.log.gz 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48366.log 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.52860.log.gz 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52451.log 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48366.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52604.log.gz 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46190.log 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48366.log.gz 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50089.log 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52451.log.gz 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52230.log 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50089.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46190.log.gz 2024-04-25T02:07:19.689 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52706.log 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50089.log.gz 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44494.log 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52230.log.gz 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51224.log 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44494.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52706.log.gz 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47176.log 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44494.log.gz 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47593.log 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51224.log.gz 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46513.log 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47593.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47176.log.gz 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2024-04-25T02:07:19.690 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47593.log.gz 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44768.log 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46513.log.gz 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53376.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44768.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45493.log 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44768.log.gz 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52655.log 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52655.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45493.log.gz 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52655.log.gz 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46404.log 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47746.log: /var/log/ceph/ceph-client.admin.49010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2024-04-25T02:07:19.691 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gz 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46404.log.gz 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47848.log 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49367.log: /var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45391.log 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51326.log 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52502.log 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47848.log.gz 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51326.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45391.log.gz 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49936.log 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49834.log 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51326.log.gz 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2024-04-25T02:07:19.692 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47074.log 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49834.log: gzip 87.3%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49936.log.gz 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52179.log 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49834.log.gz 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45289.log 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47074.log.gz 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.40841.log 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52179.log: /var/log/ceph/ceph-client.admin.45289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52179.log.gz 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45289.log.gz 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.tmp-client.admin.40841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53276.log 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.40841.log.gz 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50140.log 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53276.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48756.log 2024-04-25T02:07:19.693 INFO:teuthology.orchestra.run.smithi057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53276.log.gz 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43375.log 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50140.log: /var/log/ceph/ceph-client.admin.48756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45978.log 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50140.log.gz 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48756.log.gz 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45850.log 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48315.log 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6%/var/log/ceph/ceph-client.admin.45978.log: -- replaced with /var/log/ceph/ceph-client.admin.43375.log.gz 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45850.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45978.log.gz 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45850.log.gz 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48519.log 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48315.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48315.log.gz 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52962.log 2024-04-25T02:07:19.694 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48519.log.gz 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53166.log 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49470.log 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52962.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52758.log 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52962.log.gz 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53166.log.gz 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52553.log 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr: 95.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52758.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49470.log.gz 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49214.log 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52758.log.gz 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48162.log 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.52553.log.gz 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48009.log 2024-04-25T02:07:19.695 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49214.log.gz 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51822.log 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48162.log: /var/log/ceph/ceph-client.admin.48009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48603.log 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48162.log.gz 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48009.log.gz 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51822.log.gz 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50765.log 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48603.log.gz 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43324.log 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43425.log: /var/log/ceph/ceph-client.admin.50765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52128.log 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50765.log.gz 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44971.log 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43324.log.gz 2024-04-25T02:07:19.696 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52128.log: /var/log/ceph/ceph-client.admin.44971.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.52128.log.gz 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.51122.log 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44971.log.gz 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45646.log 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.51122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49316.log 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr: 86.7%/var/log/ceph/ceph-client.admin.45646.log: -- replaced with /var/log/ceph/ceph-client.admin.51122.log.gz 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51466.log 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.45646.log.gz 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49316.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44819.log 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49316.log.gz 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51466.log: /var/log/ceph/ceph-osd.0.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51466.log.gz 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51771.log 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44367.log 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44819.log: /var/log/ceph/ceph-client.admin.51771.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44819.log.gz 2024-04-25T02:07:19.697 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46666.log 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51771.log.gz 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52077.log 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46666.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44367.log.gz 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52077.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46666.log.gz 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52077.log.gz 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49987.log 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50191.log 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49537.log 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45979.log 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50191.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49987.log.gz 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49537.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50191.log.gz 2024-04-25T02:07:19.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45979.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49537.log.gz 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.45979.log.gz 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43474.log 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45136.log 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50969.log 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43474.log.gz 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53013.log 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44665.log 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45136.log.gz 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50969.log: /var/log/ceph/ceph-client.admin.53013.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50969.log.gz 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.53013.log.gz 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44665.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44665.log.gz 2024-04-25T02:07:19.699 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51670.log 2024-04-25T02:07:19.701 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35850.log 2024-04-25T02:07:19.701 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36471.log 2024-04-25T02:07:19.701 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.35850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35850.log.gz 2024-04-25T02:07:19.701 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.36471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36471.log.gz 2024-04-25T02:07:19.706 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-25T02:07:19.706 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m0.028s 2024-04-25T02:07:19.706 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m0.006s 2024-04-25T02:07:19.706 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.046s 2024-04-25T02:07:19.712 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52281.log 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51670.log.gz 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51975.log 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52281.log: /var/log/ceph/ceph-client.admin.48908.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.52281.log.gz 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51975.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51975.log.gz 2024-04-25T02:07:19.713 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46363.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46819.log 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45976.log 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49265.log 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45976.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46819.log.gz 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45077.log 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45976.log.gz 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49265.log: /var/log/ceph/ceph-client.admin.45077.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49265.log.gz 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45077.log.gz 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53217.log 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49588.log 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46309.log 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49588.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.53217.log.gz 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49588.log.gz 2024-04-25T02:07:19.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46309.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46309.log.gz 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51173.log 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51720.log 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47950.log 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52026.log 86.7% 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51173.log.gz 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51720.log.gz 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51924.log 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52026.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47950.log.gz 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44563.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52026.log.gz 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51924.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51924.log.gz 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52400.log 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50242.log 2024-04-25T02:07:19.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50816.log 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52400.log.gz 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50242.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:gzip 87.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.50242.log.gz--verbose 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:-- /var/log/ceph/ceph-client.admin.48857.log 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50816.log: /var/log/ceph/ceph-mgr.x.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50816.log.gz 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48857.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48857.log.gz 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45340.log 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47125.log 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45340.log: /var/log/ceph/ceph-client.admin.47125.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45340.log.gz 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51517.log 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47125.log.gz 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46921.log 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47440.log 2024-04-25T02:07:19.716 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51517.log.gz 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46921.log: /var/log/ceph/ceph-client.admin.47440.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46921.log.gz 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47440.log.gz 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50867.log 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46131.log 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50867.log: /var/log/ceph/ceph-client.admin.46131.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50867.log.gz 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46131.log.gz 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51388.log 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50612.log 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50344.log 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51388.log.gz 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50612.log: /var/log/ceph/ceph-client.admin.50344.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50612.log.gz 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50344.log.gz 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48959.log 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53325.log 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-04-25T02:07:19.717 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53325.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48959.log.gz 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53325.log.gz 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44614.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46615.log 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52911.log 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46615.log: /var/log/ceph/ceph-client.admin.52911.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46615.log.gz 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52911.log.gz 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48468.log 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49061.log 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47491.log 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49061.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48468.log.gz 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47491.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49061.log.gz 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47491.log.gz 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T02:07:19.718 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51619.log 2024-04-25T02:07:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47389.log 2024-04-25T02:07:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51619.log: /var/log/ceph/ceph-client.admin.47389.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51619.log.gz 2024-04-25T02:07:19.719 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47389.log.gz 2024-04-25T02:07:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-04-25T02:07:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T02:07:19.719 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47542.log: /var/log/ceph/ceph-mds.a.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-04-25T02:07:19.720 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T02:07:19.721 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44870.log 2024-04-25T02:07:19.722 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44870.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44870.log.gz 2024-04-25T02:07:19.723 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47899.log 2024-04-25T02:07:19.724 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47899.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47899.log.gz 2024-04-25T02:07:19.724 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53115.log 2024-04-25T02:07:19.725 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53115.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.53115.log.gz 2024-04-25T02:07:19.725 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43030.log 2024-04-25T02:07:19.727 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43030.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43030.log.gz 2024-04-25T02:07:19.727 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45442.log 2024-04-25T02:07:19.728 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45442.log: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T02:07:19.728 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45442.log.gz 2024-04-25T02:07:19.728 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T02:07:19.736 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50918.log 2024-04-25T02:07:19.737 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50918.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50918.log.gz 2024-04-25T02:07:19.738 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49783.log 2024-04-25T02:07:19.739 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49783.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49783.log.gz 2024-04-25T02:07:19.739 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45595.log 2024-04-25T02:07:19.740 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45595.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45595.log.gz 2024-04-25T02:07:19.740 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51275.log 2024-04-25T02:07:19.741 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51275.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51275.log.gz 2024-04-25T02:07:19.741 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45697.log 2024-04-25T02:07:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45697.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45697.log.gz 2024-04-25T02:07:19.742 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-04-25T02:07:19.743 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46717.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-04-25T02:07:19.743 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48705.log 2024-04-25T02:07:19.744 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48705.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48705.log.gz 2024-04-25T02:07:19.744 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51071.log 2024-04-25T02:07:19.745 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51071.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51071.log.gz 2024-04-25T02:07:19.745 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46870.log 2024-04-25T02:07:19.746 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46870.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46870.log.gz 2024-04-25T02:07:19.746 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T02:07:19.748 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T02:07:19.748 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48213.log 2024-04-25T02:07:19.749 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48213.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48213.log.gz 2024-04-25T02:07:19.749 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46124.log 2024-04-25T02:07:19.750 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46124.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46124.log.gz 2024-04-25T02:07:19.750 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-04-25T02:07:19.751 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45799.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-04-25T02:07:19.751 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50293.log 2024-04-25T02:07:19.752 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50293.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50293.log.gz 2024-04-25T02:07:19.752 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48654.log 2024-04-25T02:07:19.753 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48654.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48654.log.gz 2024-04-25T02:07:19.753 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50663.log 2024-04-25T02:07:19.754 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50663.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50663.log.gz 2024-04-25T02:07:19.754 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45024.log 2024-04-25T02:07:19.755 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45024.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45024.log.gz 2024-04-25T02:07:19.755 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47644.log 2024-04-25T02:07:19.756 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47644.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47644.log.gz 2024-04-25T02:07:19.756 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46768.log 2024-04-25T02:07:19.757 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46768.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46768.log.gz 2024-04-25T02:07:19.757 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49112.log 2024-04-25T02:07:19.758 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49112.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49112.log.gz 2024-04-25T02:07:19.758 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52333.log 2024-04-25T02:07:19.759 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52333.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52333.log.gz 2024-04-25T02:07:19.759 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47695.log 2024-04-25T02:07:19.760 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47695.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47695.log.gz 2024-04-25T02:07:19.760 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46972.log 2024-04-25T02:07:19.761 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46972.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46972.log.gz 2024-04-25T02:07:19.761 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47227.log 2024-04-25T02:07:19.762 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47227.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47227.log.gz 2024-04-25T02:07:19.762 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52809.log 2024-04-25T02:07:19.763 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52809.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52809.log.gz 2024-04-25T02:07:19.764 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51020.log 2024-04-25T02:07:19.764 INFO:teuthology.orchestra.run.smithi057.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T02:07:19.764 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46187.log 2024-04-25T02:07:19.764 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51020.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51020.log.gz 2024-04-25T02:07:19.765 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48417.log 2024-04-25T02:07:19.765 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46187.log.gz 2024-04-25T02:07:19.765 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2024-04-25T02:07:19.766 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48417.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48417.log.gz 2024-04-25T02:07:19.766 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44296.log: 87.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz--verbose 2024-04-25T02:07:19.767 INFO:teuthology.orchestra.run.smithi057.stderr:-- /var/log/ceph/ceph-client.admin.47797.log 2024-04-25T02:07:19.767 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50500.log 2024-04-25T02:07:19.767 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47797.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47797.log.gz 2024-04-25T02:07:19.768 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2024-04-25T02:07:19.768 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50500.log.gz 2024-04-25T02:07:19.769 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49418.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2024-04-25T02:07:19.769 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2024-04-25T02:07:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45544.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2024-04-25T02:07:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48807.log 2024-04-25T02:07:19.770 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48807.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48807.log.gz 2024-04-25T02:07:19.771 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50553.log 2024-04-25T02:07:19.771 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50553.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T02:07:19.771 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50553.log.gz 2024-04-25T02:07:19.773 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51568.log 2024-04-25T02:07:19.774 INFO:teuthology.orchestra.run.smithi057.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T02:07:19.775 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51568.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51568.log.gz 2024-04-25T02:07:19.775 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51873.log 2024-04-25T02:07:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51873.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz 2024-04-25T02:07:19.776 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44418.log 2024-04-25T02:07:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44418.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44418.log.gz 2024-04-25T02:07:19.779 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47278.log 2024-04-25T02:07:19.780 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47278.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47278.log.gz 2024-04-25T02:07:19.781 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2024-04-25T02:07:19.782 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49732.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2024-04-25T02:07:19.782 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2024-04-25T02:07:19.785 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47338.log 2024-04-25T02:07:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44717.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2024-04-25T02:07:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47338.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47338.log.gz 2024-04-25T02:07:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2024-04-25T02:07:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2024-04-25T02:07:19.787 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44921.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2024-04-25T02:07:19.787 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49885.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2024-04-25T02:07:19.787 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50446.log 2024-04-25T02:07:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50446.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50446.log.gz 2024-04-25T02:07:19.790 INFO:teuthology.orchestra.run.smithi057.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T02:07:19.805 INFO:teuthology.orchestra.run.smithi057.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T02:07:19.806 INFO:teuthology.orchestra.run.smithi057.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T02:07:19.823 INFO:teuthology.orchestra.run.smithi057.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T02:07:19.833 INFO:teuthology.orchestra.run.smithi057.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T02:07:19.863 INFO:teuthology.orchestra.run.smithi057.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T02:07:19.864 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-25T02:07:19.865 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m0.216s 2024-04-25T02:07:19.865 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m0.875s 2024-04-25T02:07:19.865 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m0.151s 2024-04-25T02:07:19.865 INFO:tasks.ceph:Archiving logs... 2024-04-25T02:07:19.865 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/remote/smithi057/log 2024-04-25T02:07:19.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:07:20.188 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/remote/smithi088/log 2024-04-25T02:07:20.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:07:20.258 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T02:07:20.281 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T02:07:20.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:07:20.284 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:07:20.400 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T02:07:20.410 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T02:07:20.410 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:07:20.413 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:07:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2024-04-25T02:07:20.433 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:07:20.433 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-04-25T02:07:20.433 INFO:teuthology.orchestra.run.smithi057.stdout:^- hv01.front.sepia.ceph.com 2 6 177 57 +1719us[+1719us] +/- 582ms 2024-04-25T02:07:20.433 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv02.front.sepia.ceph.com 3 6 177 57 -275us[ -220us] +/- 54ms 2024-04-25T02:07:20.433 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 56 +307us[ +307us] +/- 61ms 2024-04-25T02:07:20.433 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:20.455 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2024-04-25T02:07:20.462 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:07:20.463 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-04-25T02:07:20.463 INFO:teuthology.orchestra.run.smithi088.stdout:^- hv01.front.sepia.ceph.com 2 6 177 58 +1736us[+1732us] +/- 582ms 2024-04-25T02:07:20.463 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv02.front.sepia.ceph.com 3 6 177 58 -275us[ -279us] +/- 54ms 2024-04-25T02:07:20.463 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 59 +317us[ +313us] +/- 61ms 2024-04-25T02:07:20.463 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:07:20.464 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T02:07:20.474 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T02:07:20.475 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T02:07:20.565 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:07:20.635 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:07:20.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:07:20.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:07:20.796 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:07:20.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:07:20.866 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T02:07:20.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T02:07:20.918 INFO:teuthology.task.internal:Duration was 689.935503 seconds 2024-04-25T02:07:20.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T02:07:20.927 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T02:07:20.928 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:07:20.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:07:20.978 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:07:21.042 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:07:21.455 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T02:07:21.456 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T02:07:21.456 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:07:21.483 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-04-25T02:07:21.483 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:07:21.541 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T02:07:21.541 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:07:21.544 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:07:21.627 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T02:07:21.627 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:07:21.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:07:21.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T02:07:21.755 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T02:07:21.756 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:07:21.785 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:07:21.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T02:07:21.868 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:07:21.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:07:21.896 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-04-25T02:07:21.937 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-04-25T02:07:21.970 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:07:21.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:07:21.988 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:07:22.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:07:22.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T02:07:22.042 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T02:07:22.043 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/remote/smithi057 2024-04-25T02:07:22.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:07:22.084 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672359/remote/smithi088 2024-04-25T02:07:22.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:07:22.162 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T02:07:22.162 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:07:22.165 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:07:22.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T02:07:22.222 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T02:07:22.222 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T02:07:22.234 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T02:07:22.235 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:07:22.237 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:07:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:07 /home/ubuntu/cephtest 2024-04-25T02:07:22.295 INFO:teuthology.orchestra.run.smithi088.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:07 /home/ubuntu/cephtest 2024-04-25T02:07:22.298 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T02:07:22.309 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T02:07:22.336 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/upgrade/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/new_ops/{newops}}} duration: 689.9355034828186 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T02:07:22.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:07:22.421 INFO:teuthology.run:pass